Remote AI Content Integrity Evaluator

Scale AI; Brantford; Remote; CAD 24,000 - 34,000; Full time

Job summary

Outlier is an AI training platform operated by Scale AI. We seek detail-oriented English speakers to review AI-generated media remotely and on your own schedule.

You will roleplay live conversations with an AI voice model, score exchanges, compare images and videos to assess prompt adherence, and write explanations in English detailing observed issues. Join a flexible freelance team contributing to advancing AI systems.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in when something seems off.
• Comfortable thinking on your feet and discussing realistic situations clearly.
• Experience writing short, evidence-based explanations or reviews.
• Able to make a clear decision when both options have flaws.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos to judge which follows the prompt better.
• Inspecting outputs closely to spot distortions, flickering, text errors, or audio-visual mismatches.
• Writing specific explanations in English detailing observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Real-time thinking

Decision making under ambiguity

Education

Bachelor’s degree or above

Job description

Outlier is an AI training platform operated by Scale AI. We seek detail-oriented English speakers to review AI-generated media remotely and on your own schedule.

You will roleplay live conversations with an AI voice model, score exchanges, compare images and videos to assess prompt adherence, and write explanations in English detailing observed issues. Join a flexible freelance team contributing to advancing AI systems.