Remote AI Output Evaluator & Quality Reviewer

Scale AI; Surrey; Remote; CAD 24,000 - 34,000; Part time

Benefits offered by this job

Flexible schedule

Weekly payments

Access to leading LLMs

Job summary

Outlier, an AI evaluation platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, rank outputs, and provide written explanations of detected issues, all remotely and on your own schedule.

This freelance, 1099 opportunity allows you to work from anywhere with a flexible schedule. Applicants from multiple countries are welcome, with weekly pay terms and additional incentives based on project

Qualifications

• Fluent English with strong written communication.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models; rank naturalness and usefulness.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, and audio-video mismatch.
• Write explanations in English detailing what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Situational conversation ability

Evidence-based explanations

Education

Bachelor’s degree or above (nice to have)

Job description

Outlier, an AI evaluation platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, rank outputs, and provide written explanations of detected issues, all remotely and on your own schedule.

This freelance, 1099 opportunity allows you to work from anywhere with a flexible schedule. Applicants from multiple countries are welcome, with weekly pay terms and additional incentives based on project