Remote AI Content Evaluator — Flexible & Detail‑Oriented

Scale AI; Markham; Remote; CAD 29,000 - 41,000; Full time

Job summary

Outlier is seeking freelance English evaluators to train AI models by conducting live scenario conversations and rating model outputs. You will assess naturalness and clarity, compare visual prompts, and provide concise, evidence-based English explanations.

This remote, flexible role suits detail-oriented communicators with a Bachelor’s degree or higher. You’ll work asynchronously on various projects, with screening and onboarding steps.

Qualifications

• Fluent English with strong written communication.
• Pursuing or holding a Bachelor's degree or above.
• Attention to detail; patient with careful listening and replaying.
• Able to think on your feet and explain scenarios clearly.
• Experience writing short, evidence-based explanations.

Responsibilities

• Hold live, scenario-based English conversations with AI voice models and rate naturalness, usefulness and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs for distortions, motion issues, text and audio mismatches.
• Rate outputs on adherence, quality, realism and write explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under ambiguity

Evidence-based explanations

Bachelor's degree awareness

Education

Bachelor’s degree or above

Job description

Outlier is seeking freelance English evaluators to train AI models by conducting live scenario conversations and rating model outputs. You will assess naturalness and clarity, compare visual prompts, and provide concise, evidence-based English explanations.

This remote, flexible role suits detail-oriented communicators with a Bachelor’s degree or higher. You’ll work asynchronously on various projects, with screening and onboarding steps.