Remote AI Media Evaluator: Voice, Image & Video

Scale AI; Markham; Remote; CAD 17,000 - 29,000; Full time

Job summary

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded wrong.

You will compare AI-generated images and videos to judge prompt adherence, inspect outputs for issues like distortions, motion, or audio-video mismatch, and provide concise explanations in English. Remote and flexible schedule.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and patience to review closely.
• Ability to think on your feet and discuss realistic situations.
• Experience writing short, evidence-based reviews.
• Able to make clear decisions when options have flaws.
• Bachelor’s degree or higher (nice to have).

Responsibilities

• Hold live English conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos for prompt adherence.
• Inspect outputs for issues like distortions, flicker, or audio-video mismatch.
• Provide written explanations in English pinpointing what was observed.

Skills

Fluent English

Attention to detail

Clear written comms

Evidence-based reviews

Decision making under imperfect info

Bachelor’s degree (nice to have)

Education

Bachelor’s degree or above

Job description

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded wrong.

You will compare AI-generated images and videos to judge prompt adherence, inspect outputs for issues like distortions, motion, or audio-video mismatch, and provide concise explanations in English. Remote and flexible schedule.