Remote AI Conversation Evaluator — English Speaker

Scale AI; Medicine Hat; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule — set your own hours

Global community of 900K+ Outlier-Expe

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media on a flexible, remote schedule. You will roleplay conversations with AI voice models, rank outputs, and provide written explanations in English that cite observed issues.

The role is freelance/1099, with weekly payments and incentives based on project performance. Applicants across eligible regions can join and contribute to improving AI systems in real-world contexts.

Qualifications

• Fluent English with clear written communication.
• Patience and attention to detail; ability to replay or zoom in when something seems off.
• Ability to think on your feet and discuss realistic situations in a natural way.
• Experience writing short, evidence-based explanations or reviews.
• Bachelor’s degree or higher is a plus.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images/videos and judge alignment with prompts.
• Inspect outputs closely to spot issues like distorted visuals or mismatched audio and text.
• Write explicit explanations in English pointing to observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under uncertainty

Education

Bachelor’s degree or above (nice to have)

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media on a flexible, remote schedule. You will roleplay conversations with AI voice models, rank outputs, and provide written explanations in English that cite observed issues.

The role is freelance/1099, with weekly payments and incentives based on project performance. Applicants across eligible regions can join and contribute to improving AI systems in real-world contexts.