AI Output Quality Evaluator - Remote & Flexible

Outlier; Boulder (CO); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Pay up to $18/hr

Flexible hours

Free LLM access

Missions bonus

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

You'll help shape how advanced AI systems reason, learn, and improve by providing precise evaluations and feedback across images, videos, and audio while earning flexible, remote work with competitive hourly pay.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail, with the patience to inspect outputs carefully.
• Experience writing short, evidence-based explanations or reviews.
• Ability to decide clearly when both options have flaws.

Responsibilities

• Hold live scenario-based conversations with AI voice models and rank naturalness and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely, zooming/replaying to spot issues like artifacts or misalignment.
• Write explicit explanations in English detailing observed problems.

Skills

Fluent English

Attention to detail

Written communication

Evidence-based reviews

Decisive under ambiguity

Education

Bachelor’s degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

You'll help shape how advanced AI systems reason, learn, and improve by providing precise evaluations and feedback across images, videos, and audio while earning flexible, remote work with competitive hourly pay.