Remote AI Media & Dialogue Quality Evaluator

Scale AI; Guelph; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Weekly payments

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with an AI voice model, evaluate image/video outputs, and write clear English explanations of issues observed, all remotely and on your own schedule.

Outlier offers flexible, contract-based work with weekly payments. Applicants from Canada and other countries may participate, provided you meet the basic requirements and have a valid ID, resume, and LinkedIn profile.

Qualifications

• Fluent English with strong written communication and ability to explain observations clearly.
• Excellent attention to detail and patience to review media carefully.
• Ability to think on your feet and discuss realistic scenarios naturally.
• Experience writing brief, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos against prompts and judge which follows instructions more closely.
• Inspect outputs closely, zoom in or replay to spot issues like distorted anatomy, flickering, or audio-video mismatches.
• Write precise English explanations highlighting observed issues and adherence to prompts.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under flaws

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with an AI voice model, evaluate image/video outputs, and write clear English explanations of issues observed, all remotely and on your own schedule.

Outlier offers flexible, contract-based work with weekly payments. Applicants from Canada and other countries may participate, provided you meet the basic requirements and have a valid ID, resume, and LinkedIn profile.