AI Media Evaluator (Remote) — Flexible Hours, Up to $18/hr

Outlier; Kansas City (MO); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Hourly pay up to $18

Flexible hours

Free LLM access

Missions surge incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image and video pairs, and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your insights help shape how advanced AI systems reason and improve. Your work feeds into a feedback loop turning frontier research into practical AI improvements.

Qualifications

• Fluent English with clear written communication and comfortable with natural conversational speech.
• Strong attention to detail, with patience to replay or zoom in when something seems off.
• Nice to have: Pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and explaining realistic situations in a natural, conversational way.
• Experience writing brief, evidence-based explanations or reviews.
• Ability to make clear decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations with AI voice models in English and ranking naturalness, usefulness, and clarity.
• Comparing AI-generated image/video pairs and judging adherence to prompts.
• Inspecting outputs closely (zoom/replay) to spot issues like artifacts, flickering, or misaligned audio.
• Rating outputs across dimensions and writing specific explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable in conversational speech

Education

Bachelor's degree or above (nice to have)

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image and video pairs, and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your insights help shape how advanced AI systems reason and improve. Your work feeds into a feedback loop turning frontier research into practical AI improvements.