Remote AI Media Evaluator - Flexible Schedule

Scale AI; Prince George; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Global community of experts

Job summary

Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models.

We are seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange, compare generated images and videos to judge which follows the prompt better, and explain in writing what looked or sounded wrong, all remotely and on your own

Qualifications

• Fluent English speaker with strong, clear written communication
• Strong attention to detail and patience to replay or zoom in when something seems off
• Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way
• Experience writing short, evidence-based explanations or reviews
• Able to make a clear decision when both options have flaws
• Nice to have: Bachelor’s degree or above

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank how natural, useful, and clear each interaction sounded
• Compare pairs of AI-generated images and videos and judge which follows the prompt better
• Inspect outputs closely to spot issues like distorted anatomy, flickering motion, text errors, and audio-video mismatches
• Write a concise, English explanation referencing what you saw or heard and why you chose a particular rating

Job description

Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models.

We are seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange, compare generated images and videos to judge which follows the prompt better, and explain in writing what looked or sounded wrong, all remotely and on your own