Remote AI Media Quality Evaluator (Flexible Hours)

Outlier; New Haven (CT); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Weekly payments

Free access to leading LLMs

Flexible hours

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score the exchanges, compare generated images and videos to judge prompt adherence, and explain in writing what looked or sounded wrong, remotely and on your own schedule.

As part of Outlier’s evaluation loop, your feedback helps shape AI that reasons, learns, and improves for real-world performance.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to replay or zoom in.
• Bachelor's degree or above preferred.
• Comfortable thinking on your feet and discussing realistic situations.

Responsibilities

• Hold a live, scenario-based conversation in English with AI voice models, then rank how natural, useful, and clear each one sounded.
• Compare pairs of AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely for distortions, flickering, text errors, or audio-video misalignment.
• Write a concise English explanation detailing what you saw or heard and why.

Skills

Fluent English

Attention to detail

Clear writing

Decision making

Active listening

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score the exchanges, compare generated images and videos to judge prompt adherence, and explain in writing what looked or sounded wrong, remotely and on your own schedule.

As part of Outlier’s evaluation loop, your feedback helps shape AI that reasons, learns, and improves for real-world performance.