Remote AI Evaluation Specialist - Flexible Hours

Scale AI; Prince Albert; Hybrid; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Free access to leading LLMs

Join 900K+ Outlier Experts across 52+?

Job summary

Outlier (Scale AI-backed) is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges for naturalness and usefulness, and compare AI-generated images and videos to judge prompt adherence.

You will also explain in writing what looked or sounded off, all on a flexible, remote freelance basis with weekly USD payments. Eligible applicants from Australia, Canada, Ireland, New Zealand, the UK and the US are

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in on content.
• Ability to articulate observations with clear, concise explanations.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models.
• Rank AI outputs for naturalness, usefulness, and clarity.
• Compare AI-generated images/videos to assess adherence to prompts.
• Provide written explanations describing observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Bachelor’s degree (nice to have)

Education

Bachelor’s degree

Job description

Outlier (Scale AI-backed) is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges for naturalness and usefulness, and compare AI-generated images and videos to judge prompt adherence.

You will also explain in writing what looked or sounded off, all on a flexible, remote freelance basis with weekly USD payments. Eligible applicants from Australia, Canada, Ireland, New Zealand, the UK and the US are