Remote AI Response Evaluator — Flexible Hours

Outlier; Boston (MA); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn Up to $18 USD/hr - Plus bonuses

Flexible, remote schedule

Free access to leading LLMs

Missions incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, rate outputs, and explain in writing what looked off, all remotely and on your own schedule.

You’ll compare AI-generated images and videos to prompts, judge which follows instructions better, and provide concise, evidence-based explanations in English. Flexible hours, pay per hour, and global participation are available.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay/zoom in when something seems off.
• Nice to have: Pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and explaining your reasoning clearly.
• Experience writing short, evidence-based explanations or reviews.
• Able to decide clearly when both options have flaws.
• Eligible to work across listed regions (Australia, Canada, Ireland, United Kingdom, United States).

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models, then ranking naturalness and usefulness.
• Comparing pairs of AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely (zooming, replaying) to spot problems like artifacts or misalignment.
• Rating outputs across dimensions and writing a concise English explanation of findings.

Skills

Fluent English

Attention to detail

Written communication

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, rate outputs, and explain in writing what looked off, all remotely and on your own schedule.

You’ll compare AI-generated images and videos to prompts, judge which follows instructions better, and provide concise, evidence-based explanations in English. Flexible hours, pay per hour, and global participation are available.