AI Content Evaluator (English) - Flexible Remote

Scale AI; Ajax; Remote; CAD 23,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, and explain your reasoning in writing from a flexible, remote setup.

You’ll evaluate images, videos, captions, and audio quality, providing concise, evidence-based feedback to help improve AI systems. Join a global network of experts with weekly payments.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and careful listening.
• Ability to think on your feet and discuss real scenarios.
• Experience writing brief, evidence-based reviews.
• Bachelor’s degree or higher (nice to have).

Responsibilities

• Hold live, scenario-based English conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge alignment with the prompt.
• Inspect outputs closely; zoom/replay to spot issues such as artifacts, motion irregularities, text errors, or audio-video mismatches.
• Rate outputs on adherence, quality, and realism, then write an English explanation of what you saw or heard.

Skills

Fluent English

Attention to detail

Oral communication

Evidence-based writing

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, and explain your reasoning in writing from a flexible, remote setup.

You’ll evaluate images, videos, captions, and audio quality, providing concise, evidence-based feedback to help improve AI systems. Join a global network of experts with weekly payments.