AI Media Quality Evaluator - Remote & Flexible

Outlier; Denton (TX); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours

Free access to leading LLMs

Missions surge pricing

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and compare generated images and videos to judge adherence to prompts. You will explain in writing what looked or sounded off, all remotely and on your own schedule.

The work helps shape how advanced AI systems reason and improve, contributing to higher real-world performance. Applicants from multiple countries are welcome.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay/zoom in on outputs.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and rank how natural and clear each exchange sounds.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely, including zooming and replaying, to spot problems like distorted anatomy, flickering, or misaligned audio.
• Rating outputs across dimensions, and writing a concise English explanation of observations.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based reviews

Decision making under uncertainty

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and compare generated images and videos to judge adherence to prompts. You will explain in writing what looked or sounded off, all remotely and on your own schedule.

The work helps shape how advanced AI systems reason and improve, contributing to higher real-world performance. Applicants from multiple countries are welcome.