AI Media Evaluator — Flexible, Remote, $18/hr

Outlier; Charlottesville (VA); Hybrid; USD 17,000 - 25,000; Full time

Benefits offered by this job

Up to $18/hr

Flexible hours

Remote work

Free LLM access

Missions incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, rate how natural and useful the exchanges are, and explain what looked or sounded wrong in writing, all remotely and on your own schedule.

Contributors help shape how advanced AI systems reason and learn, supporting frontier research to improve real-world performance. Flexible, remote work with weekly payments and access to leading LLMs.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and the ability to replay or zoom in.
• Bachelor's degree or higher preferred.
• Able to think on your feet and discuss realistic scenarios.
• Experience writing concise, evidence-based reviews.
• Able to decide clearly when both options have flaws.
• Eligible to apply from Australia, Canada, Ireland, UK or US.

Responsibilities

• Holding live conversations with AI voice models, then ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging which one follows prompts better.
• Inspecting outputs and spotting problems like distorted anatomy, flickering, text errors, or mis-matched audio.
• Writing a clear, English explanation of what was observed.

Skills

Fluent English

Attention to detail

Thinking on your feet

Concise writing

Decision making

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, rate how natural and useful the exchanges are, and explain what looked or sounded wrong in writing, all remotely and on your own schedule.

Contributors help shape how advanced AI systems reason and learn, supporting frontier research to improve real-world performance. Flexible, remote work with weekly payments and access to leading LLMs.