Remote AI Data Quality Evaluator

Scale AI; Fort McMurray; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible hours

Freelance contract

Weekly payments

Job summary

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score naturalness, then explain in writing what looked or sounded off, all on a flexible schedule.

Responsibilities include comparing AI-produced images and videos to prompts, inspecting outputs for issues, and providing concise English explanations. This freelance role offers up to $15 per hour with weekly payments.

Qualifications

• Fluent English with clear writing.
• Detail-minded and patient approach to review tasks.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to decide clearly when both options have flaws.

Responsibilities

• Hold live, scenario-based English conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images/videos and judge which follows prompts better.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, or audio-video misalignment; document findings.
• Write specific explanations in English pointing to what you observed or heard.

Skills

Fluent English

Written communication

Attention to detail

Explaining reviews

Decision making

Education

Bachelor's degree or above

Job description

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score naturalness, then explain in writing what looked or sounded off, all on a flexible schedule.

Responsibilities include comparing AI-produced images and videos to prompts, inspecting outputs for issues, and providing concise English explanations. This freelance role offers up to $15 per hour with weekly payments.