Remote AI Response Evaluator | Detail-Oriented Reviews

Outlier; Anaheim (CA); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Job summary

Outlier is seeking detail-oriented contributors to review AI-generated media. You will hold live conversations with AI voice models, compare image and video outputs, and explain in writing what looked or sounded off, all remotely on your schedule.

Role focuses on evaluating adherence to prompts, realism, and quality, with payments per project and weekly payouts. Remote, flexible hours and access to leading LLMs are provided.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and careful listening.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging which follows the prompt more closely.
• Inspecting outputs closely to spot problems like distorted anatomy or audio-video mismatches.
• Rating outputs across dimensions and writing a clear explanation in English of your observations.

Skills

Fluent English

Attention to detail

Written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented contributors to review AI-generated media. You will hold live conversations with AI voice models, compare image and video outputs, and explain in writing what looked or sounded off, all remotely on your schedule.

Role focuses on evaluating adherence to prompts, realism, and quality, with payments per project and weekly payouts. Remote, flexible hours and access to leading LLMs are provided.