Remote AI Data Evaluator - Flexible Freelance (English)

Scale AI; Iqaluit; Remote; CAD 17,000 - 29,000; Full time

Job summary

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and compare AI-generated images and videos to prompts, explaining in writing what looked or sounded off.

This is a flexible, remote, contract opportunity. You\'ll rate outputs on adherence, quality, and realism, then provide concise, evidence-based write-ups.

Qualifications

• Fluent English speaker with strong, clear written communication
• Excellent attention to detail and patience to replay or zoom in when something seems off
• Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way
• Experience writing short, evidence-based explanations or reviews
• Able to make a clear decision when both options have flaws

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking naturalness and usefulness
• Comparing AI-generated images and videos and judging which follows the prompt better
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or misaligned audio
• Rating outputs across dimensions and writing concise explanations in English detailing observations

Skills

Fluent English

Attention to detail

Clear written communication

Conversational thinking

Bachelor's degree (nice to have)

Education

Bachelor’s degree or above

Job description

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and compare AI-generated images and videos to prompts, explaining in writing what looked or sounded off.

This is a flexible, remote, contract opportunity. You\'ll rate outputs on adherence, quality, and realism, then provide concise, evidence-based write-ups.