Remote AI Evaluation Specialist | Flexible Hours

Scale AI; Victoria; Hybrid; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert community

Collaboration with AI researchers

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare images and videos to judge adherence to prompts, and explain what looked wrong in writing.

Work remotely on your own schedule. This 1099 contract offers hourly pay up to USD 15, weekly payments via PayPal/AirTM/ACH, with additional incentives through Missions.

Qualifications

• Fluent English with strong, clear written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Comfortable thinking on your feet and talking through realistic scenarios.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or audio-video misalignment.
• Rating outputs on adherence, quality, and realism and writing concise explanations.

Skills

Fluent English

Attention to detail

Thinking on your feet

Evidence-based writing

Decisive when options have flaws

Bachelor’s degree (nice to have)

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare images and videos to judge adherence to prompts, and explain what looked wrong in writing.

Work remotely on your own schedule. This 1099 contract offers hourly pay up to USD 15, weekly payments via PayPal/AirTM/ACH, with additional incentives through Missions.