Remote AI Content Evaluator & Feedback Specialist

Outlier (by Scale AI); United States; Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Global expert community

Job summary

Outlier (by Scale AI) seeks detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score each exchange. You will compare AI-generated images and videos, judge prompt fidelity, and provide written explanations of any issues.

You will work remotely on a flexible schedule, reviewing tasks across multiple projects and contributing to the quality of frontier AI systems.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Experience writing concise explanations or reviews.
• Comfortable making clear decisions when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images and videos and judge which follows prompts better.
• Inspect outputs closely for issues like distorted anatomy, flickering, text errors, or mismatched audio.
• Write specific English explanations pointing to what you saw or heard, across dimensions like adherence and realism.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based writing

Decision making under imperfectoptions

Education

Bachelor's degree or above

Job description

Outlier (by Scale AI) seeks detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score each exchange. You will compare AI-generated images and videos, judge prompt fidelity, and provide written explanations of any issues.

You will work remotely on a flexible schedule, reviewing tasks across multiple projects and contributing to the quality of frontier AI systems.