Remote AI Evaluation Specialist

Scale AI; Victoria; Hybrid; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Freelance contract

Job summary

Scale AI's Outlier program seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare AI-generated images and videos, and explain discrepancies in writing.

Work remotely on your own schedule; there is no minimum hour commitment. This freelance contract offers payment up to 15 USD per hour, with additional incentives via missions.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in when needed.
• Clear, evidence-based explanations or reviews in writing.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs for issues (anatomy, motion, text, audio) and explain findings in writing.

Skills

Fluent English

Attention to detail

Written communication

Explain with evidence

Decision making with flaws

Education

Bachelor’s degree or above

Job description

Scale AI's Outlier program seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare AI-generated images and videos, and explain discrepancies in writing.

Work remotely on your own schedule; there is no minimum hour commitment. This freelance contract offers payment up to 15 USD per hour, with additional incentives via missions.