Remote AI Content Quality Evaluator

Scale AI; Barrie; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert community

Job summary

Outlier, an AI training platform owned and operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include holding live conversations, comparing AI-generated images and videos, inspecting outputs for distortions, and rating across adherence, quality, and realism with concise

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in to catch issues.
• Ability to present clear, concise explanations in writing when evaluating outputs.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing pairs of AI-generated images and videos to judge prompt adherence.
• Inspecting outputs closely for errors in anatomy, motion, text, or audio alignment.
• Writing specific explanations in English that point to what you saw or heard.”],
• CoT_job_summary_short:

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under imperfect data

Bachelor’s degree (nice to have)

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned and operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include holding live conversations, comparing AI-generated images and videos, inspecting outputs for distortions, and rating across adherence, quality, and realism with concise