Remote AI Media QA Evaluator — Flexible Hours

Outlier; Virginia Beach (VA); Remote; USD 17,000 - 25,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours, remote work

Free access to leading LLMs

Missions surge pricing bonus potential

Job summary

Outlier is looking for detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare AI-generated images and videos, and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your evaluations help shape how advanced AI systems reason, learn, and improve, turning frontier research into real-world AI performance improvements.

Qualifications

• Fluent English with strong writing and comprehension skills.
• Excellent attention to detail and ability to replay or zoom in on audio/visual outputs.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable deciding between imperfect options and providing a clear rationale.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking how natural and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely to spot problems like distorted anatomy, motion irregularities, text errors, and audio-video mismatches.
• Writing specific English explanations that point to what you saw or heard.

Skills

Fluent English

Attention to detail

Written communication

Clear decision making

Education

Bachelor's degree or above

Job description

Outlier is looking for detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare AI-generated images and videos, and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your evaluations help shape how advanced AI systems reason, learn, and improve, turning frontier research into real-world AI performance improvements.