Remote AI Evaluation & Quality Assessor

Scale AI; Oakville; Hybrid; CAD 24,000 - 34,000; Full time

Job summary

Outlier is an AI evaluation platform where you review AI-generated media by conversing with AI voice models and scoring each exchange. You will compare image and video outputs, assess realism and adherence to prompts, and write concise explanations of what looked or sounded off.

The role offers flexible, remote work with an opportunity to contribute to cutting-edge AI research and model evaluation across global projects. Prior experience writing concise reviews is valued.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail; patient and precise in review.
• Comfortable thinking on your feet and discussing realistic scenarios.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models, ranking naturalness and usefulness.
• Comparing AI-generated images and videos, judging prompt adherence.
• Inspecting outputs closely to spot issues like distortions, glitches, or misalignment.
• Writing explanations in English that point to observed issues and rationale.

Skills

Fluent English

Attention to detail

Clear written communication

Able to explain findings

Decisive under ambiguity

Education

Bachelor’s degree or above

Job description

Outlier is an AI evaluation platform where you review AI-generated media by conversing with AI voice models and scoring each exchange. You will compare image and video outputs, assess realism and adherence to prompts, and write concise explanations of what looked or sounded off.

The role offers flexible, remote work with an opportunity to contribute to cutting-edge AI research and model evaluation across global projects. Prior experience writing concise reviews is valued.