AI Output Quality Evaluator — Remote & Flexible Hours

Outlier

Frisco (TX)

Remote

USD 15,000 - 25,000

Part time

18 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Earn up to $18 USD/hr

Flexible schedule

Free access to leading LLMs

Missions surge pricing

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media by holding live conversations with AI voice models, ranking outputs, and explaining what looked or sounded off, all remotely on your own schedule.

Review tasks include comparing AI-generated images and videos to prompts, identifying issues like distorted anatomy, flickering, or audio-video mismatches, and writing concise explanations in English.

Qualifications

Fluent English with clear written communication.
Strong attention to detail and the ability to replay or zoom in when something seems off.
Nice to have: pursuing or holding a Bachelor's degree or above.
Comfortable thinking on your feet and explaining your reasoning clearly in English.
Experience writing short, evidence-based explanations or reviews.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard.