Remote AI Quality Evaluator — Flexible Hours

Scale AI; Pickering; Remote; CAD 29,000 - 41,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to train AI models from home. You will participate in live conversations with AI voice models, rank the naturalness and usefulness of outputs, and compare AI-generated media against prompts. You’ll also inspect for errors and write concise explanations, contributing to high-quality model improvements. This remote, freelance role offers flexible hours and project-based work.

Qualifications

• Fluent English with strong written communication.
• High attention to detail and patience to replay or zoom in when something seems off.
• Ability to think on your feet and explain realistic scenarios clearly.
• Experience writing concise, evidence-based explanations or reviews.
• Able to make clear decisions when options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI models and rate naturalness, usefulness and clarity.
• Compare AI-generated images and videos and judge which follows prompts better.
• Inspect outputs closely for issues like distorted movement or misaligned audio, using zoom and replay as needed.
• Provide written explanations in English pointing to observed issues and improvements.

Skills

Fluent English

Attention to detail

Think on your feet

Explanations in writing

Clear decision making

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to train AI models from home. You will participate in live conversations with AI voice models, rank the naturalness and usefulness of outputs, and compare AI-generated media against prompts. You’ll also inspect for errors and write concise explanations, contributing to high-quality model improvements. This remote, freelance role offers flexible hours and project-based work.