Remote AI Evaluation & Quality Feedback Specialist

Scale AI; Richmond Hill; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Global expert network

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare AI images and videos to judge prompt adherence, all remotely on your own schedule.

You’ll write concise explanations in English describing what looked or sounded off, helping shape AI systems. This freelance role offers flexible hours, weekly payments, and access to leading language

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail for media reviews.
• Ability to explain judgments in writing.
• Comfortable deciding between imperfect options.

Responsibilities

• Hold live, scenario-based English conversations with AI voice models and rate naturalness, usefulness and clarity.
• Compare AI-generated images and videos to judge prompt adherence.
• Inspect outputs to spot issues like distortion, flicker or audio-video mismatch.
• Write concise English explanations describing what you saw or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Experience explaining judgments

Bachelor's degree nice to have

Education

Bachelor’s degree or above (nice to have)

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare AI images and videos to judge prompt adherence, all remotely on your own schedule.

You’ll write concise explanations in English describing what looked or sounded off, helping shape AI systems. This freelance role offers flexible hours, weekly payments, and access to leading language