AI Media Quality Evaluator (Remote, Flexible Hours)

Outlier; Tempe (AZ); Remote; USD 17,000 - 25,000; Part time

Benefits offered by this job

Up to $18/hr

Flexible hours

Free LLM access

Performance incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare generated images and videos for prompt adherence, and explain in writing what looked or sounded off, all remotely and on your own schedule.

You will help shape how advanced AI systems reason and learn by contributing precise feedback through evaluations and reports.

Qualifications

• Fluent English speaker with strong written communication.
• Excellent attention to detail and ability to replay or zoom in to spot issues.
• Experience writing short, evidence-based explanations or reviews.
• Ability to decide clearly when both options have flaws.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness and clarity.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely for artifacts, misalignment, or audio/video mismatch.
• Write detailed explanations in English pointing to what was observed.

Skills

Fluent English

Attention to detail

Bachelor's degree or above

Clear written communication

Decision making

Review writing experience

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare generated images and videos for prompt adherence, and explain in writing what looked or sounded off, all remotely and on your own schedule.

You will help shape how advanced AI systems reason and learn by contributing precise feedback through evaluations and reports.