Remote AI Media Evaluator

Outlier; Aurora (CO); Hybrid; USD 12,000 - 21,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Weekly payments

Job summary

Outlier is seeking detail-oriented, English-speaking evaluators to review AI-generated media from home on a flexible schedule. You will roleplay conversations with AI voice models, score exchanges for naturalness and usefulness, and explain what looked or sounded off in writing.

Responsibilities include comparing AI-generated images and videos to prompts, inspecting outputs for artifacts, and rating quality across dimensions. This is a freelance, remote opportunity that shapes AI behavior.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Bachelor's degree or higher preferred.
• Comfortable explaining decisions in writing.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models.
• Comparing pairs of AI-generated images and videos for prompt adherence.
• Inspecting outputs closely to spot problems like distortions or audio/video mismatch.
• Rating outputs across dimensions and writing explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under uncertainty

Evidence-based writing

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented, English-speaking evaluators to review AI-generated media from home on a flexible schedule. You will roleplay conversations with AI voice models, score exchanges for naturalness and usefulness, and explain what looked or sounded off in writing.

Responsibilities include comparing AI-generated images and videos to prompts, inspecting outputs for artifacts, and rating quality across dimensions. This is a freelance, remote opportunity that shapes AI behavior.