Remote AI Interaction Evaluator – Flexible Schedule

Scale AI; Fort McMurray; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert community

Collaborate with experts

Job summary

Outlier, an AI training platform owned by Scale AI, is seeking detail-oriented English speakers to review AI-generated media and rate live conversations with AI voice models. You will rank naturalness and usefulness, compare AI outputs to prompts, and explain what looked or sounded wrong, all from a remote setting.

Responsibilities include examining images, videos, and captions, rating adherence and quality, and writing concise explanations in English.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and careful listening/speaking.
• Clear, concise, evidence-based explanations or reviews.
• Able to think on your feet and explain reasoning aloud.
• Capable of making decisions when options have flaws.

Responsibilities

• Hold live, scenario-based English conversations with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to spot distortions, flicker, motion issues, text errors, or audio mismatch.
• Provide written explanations of observations and judgments in English.

Skills

Fluent English

Attention to detail

Clear writing

Quick thinker

Decision making

Education

Bachelor’s degree or higher

Job description

Outlier, an AI training platform owned by Scale AI, is seeking detail-oriented English speakers to review AI-generated media and rate live conversations with AI voice models. You will rank naturalness and usefulness, compare AI outputs to prompts, and explain what looked or sounded wrong, all from a remote setting.

Responsibilities include examining images, videos, and captions, rating adherence and quality, and writing concise explanations in English.