Remote AI Evaluation Specialist – English

Scale AI; New Westminster; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Free access to leading LLMs

Global community of 900K+ experts

Job summary

Outlier, an AI training platform backed by Scale AI, is seeking detail-oriented English speakers to review AI-generated media and score exchanges with live AI voice models. You will rank naturalness, usefulness, and clarity, then explain observed issues in writing from anywhere with flexible hours.

Responsibilities include comparing AI-generated images/videos, inspecting outputs for artifacts, and delivering concise, evidence-based explanations.

Qualifications

• Fluent English speaker with strong writing skills.
• Excellent attention to detail and ability to replay or zoom in to spot issues.
• Ability to think on your feet and discuss realistic scenarios naturally.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to decide clearly when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot problems like distorted visuals, flickering, or misaligned audio.
• Provide written explanations detailing what you saw or heard that justify your rating.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based reviews

Decision making under ambiguity

Bachelor’s degree (nice to have)

Education

Bachelor’s degree

Job description

Outlier, an AI training platform backed by Scale AI, is seeking detail-oriented English speakers to review AI-generated media and score exchanges with live AI voice models. You will rank naturalness, usefulness, and clarity, then explain observed issues in writing from anywhere with flexible hours.

Responsibilities include comparing AI-generated images/videos, inspecting outputs for artifacts, and delivering concise, evidence-based explanations.