AI Media Evaluator — Remote, Flexible Hours

Outlier; Gilbert (AZ); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will role‑play live conversations with an AI voice model and score exchanges, compare generated images and videos for prompt adherence, and explain what looked or sounded wrong in writing, all remotely and on your own schedule.

Join Outlier to help shape how AI systems reason and learn, contributing to a broad feedback loop that improves AI performance in the real world.

Qualifications

• Fluent English with strong written communication and natural conversational pace.
• Excellent attention to detail; patient and precise in review tasks.
• Experience writing short, evidence-based explanations or reviews.
• Able to think clearly and decide when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking naturalness and usefulness.
• Comparing pairs of AI-generated images and videos to judge adherence to prompts.
• Inspecting outputs closely (zooming/replaying) to spot issues like distorted motion or text errors.
• Rating each output across dimensions (adherence, quality, realism) and writing an English explanation.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable discussing real scenarios

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will role‑play live conversations with an AI voice model and score exchanges, compare generated images and videos for prompt adherence, and explain what looked or sounded wrong in writing, all remotely and on your own schedule.

Join Outlier to help shape how AI systems reason and learn, contributing to a broad feedback loop that improves AI performance in the real world.