AI Media Evaluator — Remote, Flexible Hours

Outlier; Billings (MT); Remote; USD 20,000 - 29,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will stage live conversations with AI voice models, score exchanges, and compare images and videos to judge fidelity to prompts.

You will also write concise, evidence-based explanations of what looked or sounded off, all from home and on your own schedule. As part of Outlier’s evaluation loop, your feedback shapes how frontier AI systems reason and improve, contributing to better real-world AI performance.

Qualifications

• Fluent English and strong written communication are required.
• Excellent attention to detail and the ability to replay or zoom in when reviewing media.

Responsibilities

• Hold live conversations with AI voice models and rank naturalness and clarity.
• Compare AI-generated images and videos to determine which follows the prompt better.
• Inspect outputs for distortions, flickering, text errors, or audio-video mismatches.
• Write concise explanations in English describing what was off and why.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under imperfect data

Experience writing short explanations

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will stage live conversations with AI voice models, score exchanges, and compare images and videos to judge fidelity to prompts.

You will also write concise, evidence-based explanations of what looked or sounded off, all from home and on your own schedule. As part of Outlier’s evaluation loop, your feedback shapes how frontier AI systems reason and improve, contributing to better real-world AI performance.