Remote AI Evaluation & Feedback Specialist

Scale AI; Coquitlam; Remote; CAD 24,000 - 34,000; Full time

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include comparing AI-generated images/videos, inspecting outputs for issues, and writing concise explanations in English.

Qualifications

• Fluent English with strong, clear written communication.
• Excellent attention to detail and ability to replay or zoom in when something seems off.
• Ability to think on your feet and discuss realistic scenarios naturally.
• Experience writing short, evidence-based explanations or reviews.
• Capable of making clear decisions when two options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely for issues like distorted anatomy, glitches, textual errors, or audio-video mismatches.
• Write specific English explanations pointing to observed issues.

Skills

English fluency

Attention to detail

Adaptability

Clear decision-making

Writing experience

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded wrong, all remotely and on your own schedule.

Responsibilities include comparing AI-generated images/videos, inspecting outputs for issues, and writing concise explanations in English.