Remote AI Output Evaluator — Live Conversations & Media Review

Scale AI; Fort McMurray; Hybrid; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

1099 freelance contract

Weekly payments

Free access to leading LLMs

Global expert community

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges on realism and adherence to prompts. You will compare AI-generated images/videos and write concise explanations of issues found.

Earn up to USD $15 per hour with additional incentive opportunities. Work remotely on your own schedule, with weekly pay and access to leading LLMs.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to review closely.
• Able to think on your feet and discuss realistic scenarios naturally.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations with AI voice models in English.
• Rank naturalness, usefulness, and clarity of responses; explain observations in writing.
• Compare AI-generated images and videos against prompts and judge adherence to instructions.
• Inspect outputs closely, zooming/replaying to spot issues (distortions, flicker, misalignment).
• Provide written explanations highlighting what was seen or heard.

Skills

Fluent English

Attention to detail

Verbal and written communication

Decision making in imperfect scenarios

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges on realism and adherence to prompts. You will compare AI-generated images/videos and write concise explanations of issues found.

Earn up to USD $15 per hour with additional incentive opportunities. Work remotely on your own schedule, with weekly pay and access to leading LLMs.