AI Media Evaluator — Remote, Flexible Hours

Outlier; Eugene (OR); Hybrid; USD 20,000 - 29,000; Full time

Benefits offered by this job

Up to $18/hr

Flexible hours

Free access to LLMs

Missions surge pricing

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with AI voice models, compare media pairs, and provide written explanations of what looked or sounded off.

You'll help evaluate how well outputs follow prompts, judge quality and realism, and contribute to improving AI systems through structured feedback. Flexible scheduling and weekly payments are part of the role.

Qualifications

• Fluent English with strong written communication and ability to explain observations clearly.
• Great attention to detail; patient with close review and the ability to replay or zoom in.

Responsibilities

• Hold live conversations with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos to ensure alignment with prompts and quality.
• Inspect outputs closely to spot problems like distorted anatomy, flickering, or audio-video mismatches; document findings in English.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with AI voice models, compare media pairs, and provide written explanations of what looked or sounded off.

You'll help evaluate how well outputs follow prompts, judge quality and realism, and contribute to improving AI systems through structured feedback. Flexible scheduling and weekly payments are part of the role.