Remote AI Evaluation Specialist

Outlier; Seattle (WA); Remote; USD 12,000 - 21,000; Part time

Job summary

Outlier is hiring remote-based evaluators to review AI-generated media by holding live conversations with AI voice models, ranking outputs, and explaining discrepancies in writing. You can work on your own schedule from home or while traveling, with pay per hour and additional incentives.

Ideal candidates are fluent in English, detail-oriented, and capable of clear, concise explanations. This contract role offers freedom, flexible hours, and the chance to influence how AI systems interpret media.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Strong attention to detail and the patience to look and listen closely.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making a clear decision when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking how natural, useful, and clear each sounded.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering or unwanted motion, and audio-video mismatches.
• Rating outputs across dimensions and writing a specific explanation in English outlining what was seen or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Thinking on your feet

Evidence-based explanations

Education

Bachelor's degree or above

Job description

Outlier is hiring remote-based evaluators to review AI-generated media by holding live conversations with AI voice models, ranking outputs, and explaining discrepancies in writing. You can work on your own schedule from home or while traveling, with pay per hour and additional incentives.

Ideal candidates are fluent in English, detail-oriented, and capable of clear, concise explanations. This contract role offers freedom, flexible hours, and the chance to influence how AI systems interpret media.