Remote AI Evaluation & Training Specialist

Scale AI; Niagara Falls; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Global community of experts

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank responses for naturalness, and explain in writing what looked or sounded off, all on your own schedule and remotely.

Responsibilities include comparing AI-generated images and videos to prompts, labeling captions, and rating outputs across adherence, quality, and realism with concise explanations in English.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay or zoom in to spot issues.
• Comfortable thinking on your feet and explaining decisions in natural, conversational style.
• Experience writing concise, evidence-based explanations or reviews.
• Able to decide clearly when both options have flaws.
• Bachelor’s degree or higher is desirable.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging prompt adherence.
• Inspecting outputs closely to spot issues like distorted visuals or misaligned audio.
• Writing specific explanations in English that describe what was seen or heard and why it mattered.

Skills

Fluent English

Attention to detail

Verbal reasoning

Evidence-based writing

Decision making

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank responses for naturalness, and explain in writing what looked or sounded off, all on your own schedule and remotely.

Responsibilities include comparing AI-generated images and videos to prompts, labeling captions, and rating outputs across adherence, quality, and realism with concise explanations in English.