Remote AI Evaluation Specialist (Flexible Schedule)

Scale AI; Sarnia; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert network

Job summary

Outlier, an AI training platform owned and operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media by roleplaying live conversations with AI voice models and scoring exchanges. You will compare AI-generated images and videos, assess adherence to prompts, and explain issues in writing.

Work remotely on your own schedule from Canada, with weekly payments up to USD 15 per hour plus incentives.

Qualifications

• Fluent English with strong written communication.
• Keen attention to detail and the ability to replay or zoom in.
• Comfortable thinking on your feet and discussing realistic situations.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models; rank naturalness, usefulness, and clarity.
• Compare AI-generated images/videos and judge which better follows the prompt.
• Inspect outputs to spot issues like distorted anatomy, flicker, or misaligned audio.
• Write concise explanations in English detailing observed issues and decisions.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned and operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media by roleplaying live conversations with AI voice models and scoring exchanges. You will compare AI-generated images and videos, assess adherence to prompts, and explain issues in writing.

Work remotely on your own schedule from Canada, with weekly payments up to USD 15 per hour plus incentives.