AI Media Evaluator (Remote, Flexible Hours)

Outlier

Fort Worth (TX)

Remote

USD 20,000 - 29,000

Full time

19 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hourly pay

Up to $18/hr

Flexible hours

Remote work

Free LLM access

Weekly payments

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media by holding live conversations with an AI voice model and scoring the exchanges. You compare AI-generated images and videos to assess which follows the prompt more closely and explain in writing what looked or sounded off—remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve through evaluation and feedback.

Qualifications

Fluent English with clear written communication and comfortable with natural conversational speech.
Strong attention to detail and patience to replay or zoom in when something seems off.
Nice to have: pursuing or holding a Bachelor's degree or above.
Comfortable thinking on your feet and discussing realistic situations in natural conversations.
Experience writing short, evidence-based explanations or reviews.
Able to decide clearly when both options have flaws.

Responsibilities

Holding live, scenario-based conversations in English with AI voice models and ranking how natural, useful, and clear each one sounded.
Comparing AI-generated images and videos and judging which follows the prompt better.
Inspecting outputs closely (zooming in, replaying) to spot issues like distorted anatomy, flicker, or misaligned audio.
Rating each output across dimensions (adherence, quality, realism) and writing a specific English explanation of what was observed.