Remote AI Media Evaluator (English) — Flexible Hours

Outlier; Dallas (TX); Remote; USD 17,000 - 21,000; Full time

Job summary

Outlier is seeking detail-oriented, English-speaking evaluators to review AI-generated media remotely and on a flexible schedule. You will roleplay live conversations with AI voice models, compare generated images and videos for prompt adherence, and explain findings in writing, all from home.

Your work helps refine frontier AI systems through ongoing evaluation. Responsibilities include rating outputs for clarity, realism, and usefulness, and providing written explanations.

Qualifications

• Fluent English with clear written communication.
• High attention to detail and careful review of content.
• Experience writing short, evidence-based explanations or reviews.
• Ability to decide clearly when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering, or misaligned audio.
• Rating outputs across dimensions like adherence, quality, and realism, then writing a concise English explanation.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under uncertainty

Evidence-based writing

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented, English-speaking evaluators to review AI-generated media remotely and on a flexible schedule. You will roleplay live conversations with AI voice models, compare generated images and videos for prompt adherence, and explain findings in writing, all from home.

Your work helps refine frontier AI systems through ongoing evaluation. Responsibilities include rating outputs for clarity, realism, and usefulness, and providing written explanations.