AI Evaluation Specialist — Remote & Flexible Hours

Scale AI; Sooke; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Work from anywhere

Free access to leading LLMs

Global expert community

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and rank outputs for naturalness, usefulness, and clarity. You’ll compare AI-generated images and videos to judge prompt adherence, and write clear explanations of what looked or sounded off.

Contributors work remotely on their own schedule, earning per hour with additional incentives. No minimum hours and PayPal/Ach options supported.

Qualifications

• Fluent English with strong written communication for explanations.
• Excellent attention to detail and ability to replay/analyze media.
• Able to decide clearly when multiple options have flaws.

Responsibilities

• Hold live, scenario-based conversations with AI voice models in English.
• Rank outputs for naturalness, usefulness, and clarity.
• Compare AI-generated images/videos and judge prompt adherence.
• Write concise, evidence-based explanations of findings in English.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based writing

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and rank outputs for naturalness, usefulness, and clarity. You’ll compare AI-generated images and videos to judge prompt adherence, and write clear explanations of what looked or sounded off.

Contributors work remotely on their own schedule, earning per hour with additional incentives. No minimum hours and PayPal/Ach options supported.