Remote AI Media Quality Evaluator

Outlier; Denver (CO); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Job summary

Outlier invites detail-oriented English speakers to evaluate AI-generated media by holding live conversations with AI voice models, comparing image and video pairs, and explaining what’s off in writing. This remote, flexible role helps shape how advanced AI systems reason and improve through structured feedback.

Participants review outputs, rate adherence and quality, and have access to leading LLMs with weekly pay.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and the ability to replay or zoom in when needed.
• Bachelor’s degree (or higher) is a nice-to-have.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos to judge adherence to prompts.
• Inspect outputs closely (zoom/replay) to spot issues like artifacts, motion problems, or audio-video mismatch.
• Write a concise, evidence-based explanation in English for every evaluation.

Skills

Fluent English

Attention to detail

Clear written communication

Think on your feet

Education

Bachelor's degree or above

Job description

Outlier invites detail-oriented English speakers to evaluate AI-generated media by holding live conversations with AI voice models, comparing image and video pairs, and explaining what’s off in writing. This remote, flexible role helps shape how advanced AI systems reason and improve through structured feedback.

Participants review outputs, rate adherence and quality, and have access to leading LLMs with weekly pay.