AI Response Evaluator — Remote & Flexible Hours

Outlier; Arlington (TX); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Up to $18/hr

Flexible hours

Free access to leading LLMs

Missions incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image and video outputs, and explain what looks or sounds off, all on your own schedule. Your insights help shape how AI systems improve in real-world use.

Earn up to $18 USD/hr with flexible hours and weekly payments. Remote work from anywhere, with access to leading large language models, plus incentives through Outlier Missions.

Qualifications

• Fluent English communication in writing and speaking.
• Strong attention to detail, with patience to replay or zoom in.
• Ability to think on your feet and discuss realistic situations naturally.
• Experience writing short, evidence-based explanations or reviews.
• Ability to make clear decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging prompt adherence.
• Inspecting outputs for problems like distortion, flicker, or misaligned audio/video and noting issues.
• Writing a concise explanation in English describing what was observed and why.

Skills

Fluent English

Attention to detail

Think on your feet

Evidence-based explanations

Clear decision making

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image and video outputs, and explain what looks or sounds off, all on your own schedule. Your insights help shape how AI systems improve in real-world use.

Earn up to $18 USD/hr with flexible hours and weekly payments. Remote work from anywhere, with access to leading large language models, plus incentives through Outlier Missions.