AI Media Evaluator — Remote, Flexible Hours

Outlier; Alexandria (VA); Hybrid; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Weekly payments via ACH, PayPal, AirTM

Free access to leading LLMs

Flexible hours

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible-hours basis. You will roleplay live conversations with AI voice models, compare image and video outputs, and explain what’s off in writing, from home or while traveling.

Your work feeds frontier AI research into practical improvements. Ideal candidates are fluent in English, detail-oriented, with strong writing skills, and able to judge AI outputs critically.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable thinking on your feet and explaining realistic situations in conversation.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs to spot issues like distorted anatomy, motion issues, text errors, and audio-video mismatches.
• Rating outputs across dimensions (adherence, quality, realism) and writing explanations in English.

Skills

Fluent English

Attention to detail

Clear writing

Experience evaluating AI outputs

Strong written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible-hours basis. You will roleplay live conversations with AI voice models, compare image and video outputs, and explain what’s off in writing, from home or while traveling.

Your work feeds frontier AI research into practical improvements. Ideal candidates are fluent in English, detail-oriented, with strong writing skills, and able to judge AI outputs critically.