Remote AI Evaluation Specialist – Flexible Schedule

Scale AI; Prince George; Remote; CAD 24,000 - 34,000; Part time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule, work from anywhere

Weekly payments

Job summary

Outlier, an AI evaluation platform operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media on a flexible schedule. You will roleplay live conversations, compare outputs, and explain in writing what looked or sounded off, all remotely as a freelance contributor.

This 1099 opportunity offers weekly payments, access to leading LLMs, and the chance to work with a global team of experts across multiple projects.

Qualifications

• Fluent English with clear written communication
• High attention to detail and precision in reviews
• Ability to articulate observations with evidence
• Comfortable deciding between flawed options
• Nice to have: Bachelor’s degree or above

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness
• Compare AI-generated images and videos, judge prompt adherence, and explain reasoning in writing
• Inspect outputs closely, spotting issues like distortion, flicker, or audio-video mismatch
• Write concise, evidence-based explanations detailing what was observed

Skills

Fluent English

Strong written communication

Attention to detail

Decision making under imperfect info

Education

Bachelor’s degree or higher

Job description

Outlier, an AI evaluation platform operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media on a flexible schedule. You will roleplay live conversations, compare outputs, and explain in writing what looked or sounded off, all remotely as a freelance contributor.

This 1099 opportunity offers weekly payments, access to leading LLMs, and the chance to work with a global team of experts across multiple projects.