Remote AI Data Quality Evaluator | Flexible Hours

Scale AI; Surrey; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global network of 900K+ OutlierExperts

Job summary

Outlier is an AI training platform operated by Scale AI. We seek detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges.

You will compare AI-generated images and videos, judging adherence to prompts and quality, while writing clear explanations of any issues. Ideal candidates are fluent in English with strong written communication, meticulous attention to detail, and comfortable thinking on their feet.

Qualifications

• Fluent English with clear written communication.
• Attention to detail and ability to explain decisions.
• Comfortable thinking on your feet in conversational scenarios.

Responsibilities

• Hold live, scenario-based conversations with AI voice models in English.
• Rank naturalness and usefulness of responses and explain observations in writing.
• Inspect AI outputs (images, videos, audio) for quality and fidelity and note issues.
• Provide concise, evidence-based explanations for scoring decisions.

Skills

Fluent English

Written communication

Attention to detail

Decision making

Education

Bachelor’s degree or above

Job description

Outlier is an AI training platform operated by Scale AI. We seek detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges.

You will compare AI-generated images and videos, judging adherence to prompts and quality, while writing clear explanations of any issues. Ideal candidates are fluent in English with strong written communication, meticulous attention to detail, and comfortable thinking on their feet.