Remote English AI Media Evaluator — Flexible Hours

Outlier; Pittsburgh (Allegheny County); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Access to leading LLMs

Job summary

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media. You will hold live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason, learn, and improve. You'll review prompts, rank outputs, and provide written explanations to support system improvements, all from home with flexible hours.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Bachelor's degree or higher preferred.
• Comfortable discussing realistic scenarios naturally.
• Experience writing short, evidence-based explanations or reviews.
• Able to decide clearly when both options have flaws.

Responsibilities

• Holding live conversations with AI voice models and ranking naturalness and clarity.
• Comparing AI-generated images/videos and judging adherence to prompt.
• Inspecting outputs for distortions, flicker, or audio-video mismatch and explaining issues in writing.
• Writing explanations in English that point to what you saw or heard.

Skills

Fluent English

Clear written communication

Attention to detail

Evidence-based explanations

Decision making under flaws

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media. You will hold live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason, learn, and improve. You'll review prompts, rank outputs, and provide written explanations to support system improvements, all from home with flexible hours.