Remote AI Evaluation & Feedback Specialist

Scale AI; Chestermere; Hybrid; CAD 25,000 - 33,000; Part time

Benefits offered by this job

Flexible schedule

Work from anywhere

Free access to leading LLMs

Job summary

Outlier, a Scale AI-backed AI training platform, seeks detail-oriented English speakers to review AI-generated media remotely and on your own schedule. You will roleplay live conversations with an AI voice model, then rank naturalness and usefulness while explaining findings in written form.

Responsibilities include comparing AI-generated images and videos to prompts, inspecting for faults, and rating across adherence, quality and realism.

Qualifications

• Fluent English with strong written communication.
• Attention to detail and ability to replay or zoom in when something seems off.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to decide clearly when both options have flaws.
• Bachelor’s degree or above is a bonus.

Responsibilities

• Hold live, scenario-based English conversations with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos to judge adherence to prompts.
• Inspect outputs closely to identify issues like distorted anatomy, flicker, or audio mismatches.
• Provide written explanations pointing to what was seen or heard, across dimensions like adherence, quality, and realism.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under imperfectOptions

Experience writing explanations

Education

Bachelor’s degree or above

Job description

Outlier, a Scale AI-backed AI training platform, seeks detail-oriented English speakers to review AI-generated media remotely and on your own schedule. You will roleplay live conversations with an AI voice model, then rank naturalness and usefulness while explaining findings in written form.

Responsibilities include comparing AI-generated images and videos to prompts, inspecting for faults, and rating across adherence, quality and realism.