Remote English AI Quality Assessor

Scale AI; Guelph; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert network

Collaborate with experts

Job summary

Scale AI's Outlier platform is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare AI-generated images and videos to prompts, and explain in writing what looked or sounded wrong, all remotely on your own schedule.

Contributors rate outputs across adherence, quality, and realism, then provide concise, evidence-based explanations.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail; patient and precise in reviews.
• Able to think on your feet and explain scenarios clearly.
• Experience writing concise, evidence-based explanations or reviews.
• Able to decide clearly when options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like distortions, flickering or misalignment.
• Write explanations in English pointing to observed issues and rationale.

Skills

Fluent English

Attention to detail

Clear verbal reasoning

Evidence-based writing

Decision making under ambiguity

Bachelor’s degree or above

Education

Bachelor’s degree or above

Job description

Scale AI's Outlier platform is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare AI-generated images and videos to prompts, and explain in writing what looked or sounded wrong, all remotely on your own schedule.

Contributors rate outputs across adherence, quality, and realism, then provide concise, evidence-based explanations.