Remote AI Response Evaluator — Flexible Hours, Up to $15/hr

Outlier; Athens (GA); Remote; USD 12,000 - 21,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will hold live conversations with AI voice models, compare image and video outputs, and explain misalignments in writing, contributing to research-ready feedback from your own schedule.

The role emphasizes accuracy, clear communication, and the ability to evaluate AI outputs across multiple media types. Freelance, 1099 contract work with weekly payments and variable incentives.

Qualifications

• Fluent English with clear written communication and comfortable with natural everyday conversational speech.
• Strong attention to detail, with patience to look and listen closely, and to replay or zoom in when something seems off.
• Pursuing or holding a Bachelor’s degree or above.
• Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing AI-generated image and video pairs and judging which one better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English.
• Coordinating image/video evaluations and providing detailed, evidence-based feedback.

Skills

Fluent English

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will hold live conversations with AI voice models, compare image and video outputs, and explain misalignments in writing, contributing to research-ready feedback from your own schedule.

The role emphasizes accuracy, clear communication, and the ability to evaluate AI outputs across multiple media types. Freelance, 1099 contract work with weekly payments and variable incentives.