Remote AI Media Evaluator — Shape Real-World AI

Outlier; Bellevue (WA); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Hourly pay up to $18

Flexible schedule

Free access to LLMs

Missions incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and write explanations of what’s off, all on your own schedule and remotely.

Responsibilities include ranking outputs for naturalness and accuracy, analyzing how well each piece follows prompts, and providing concise, evidence-based feedback. All work is remote with flexible hours.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in.
• Nice to have: pursuing or holding a Bachelor's degree.
• Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way.
• Experience writing short, evidence-based explanations or reviews.
• Able to make a clear decision when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models, then rank naturalness, usefulness and clarity.
• Compare AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely, including zooming and replaying, to spot problems like distorted anatomy or audio-video mismatches.
• Write a concise explanation in English detailing what you saw or heard for each exchange.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable thinking on your feet

Education

Bachelor's degree or above (nice to have)

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and write explanations of what’s off, all on your own schedule and remotely.

Responsibilities include ranking outputs for naturalness and accuracy, analyzing how well each piece follows prompts, and providing concise, evidence-based feedback. All work is remote with flexible hours.