Remote AI Quality Evaluator — Flexible Schedule

Scale AI; Richmond Hill; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Join 900K+ Outlier Experts

Collaboration with field experts

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay conversations with an AI voice model, compare outputs to prompts, and explain issues in writing from any location with a flexible schedule.

Responsibilities include evaluating images, videos, captions, and audio quality, while providing concise, evidence-based explanations to improve AI systems. This is a freelance/contract role with remote work options.

Qualifications

• Fluent English with strong written communication skills.
• Excellent attention to detail and ability to replay or zoom in to spots inconsistencies.
• Comfortable thinking on your feet and describing scenarios clearly.
• Experience writing concise, evidence-based explanations or reviews.
• Able to decide between options when both have flaws; bachelor’s degree is a plus.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to identify issues like distortions, flickering, or misaligned audio.
• Provide written explanations detailing what was observed and why the choice was made.

Skills

Fluent English

Attention to detail

Clear written communication

Explain decisions clearly

Decision-making under ambiguity

Education

Bachelor’s degree preferred

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay conversations with an AI voice model, compare outputs to prompts, and explain issues in writing from any location with a flexible schedule.

Responsibilities include evaluating images, videos, captions, and audio quality, while providing concise, evidence-based explanations to improve AI systems. This is a freelance/contract role with remote work options.