AI Media Evaluator: Voice, Image & Video QA

Scale AI; Chilliwack; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Weekly payments

Job summary

Scale AI, via its Outlier platform, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate naturalness and usefulness, and explain what looked or sounded off.

You will compare AI-generated images and videos to prompts, identify issues like distorted visuals or audio/video misalignment, and provide concise written feedback. Flexible, contract-friendly schedule.

Qualifications

• Fluent English with strong written communication.
• Attention to detail; patient for close viewing/listening.
• Able to write concise, evidence-based explanations.
• Comfortable discussing realistic scenarios aloud.
• Bachelor’s degree or higher is a plus.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness.
• Compare pairs of AI-generated images/videos and judge which adheres to the prompt.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, or audio-visual mismatches.
• Write detailed explanations in English pointing to observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Scenario-based thinking

Ability to write evidence-based notes

Education

Bachelor’s degree or above (nice to have)

Job description

Scale AI, via its Outlier platform, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate naturalness and usefulness, and explain what looked or sounded off.

You will compare AI-generated images and videos to prompts, identify issues like distorted visuals or audio/video misalignment, and provide concise written feedback. Flexible, contract-friendly schedule.