Remote AI Conversation Evaluator - English Speaker

Scale AI; Warman; Remote; CAD 17,000 - 29,000; Part time

Benefits offered by this job

Flexible schedule

Weekly payments

Free LLM access

Global expert community

Job summary

Outlier, powered by Scale AI, is seeking detail-oriented English speakers to review AI-generated media. You will play out live conversations with an AI voice model and assess how natural each exchange sounds.

You will compare AI-generated images and videos, judge prompt adherence, and explain issues in writing. Contributors work remotely on a flexible schedule, earning hourly pay with weekly payouts and performance incentives, plus access to leading LLMs.

Qualifications

• Fluent English with strong written communication skills.
• Detail oriented with patience to review AI outputs.
• Ability to write evidence-based explanations in English.
• Comfortable deciding between options with flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Judge AI-generated images and videos for prompt adherence and quality.
• Inspect outputs closely to identify distortions, flicker, text errors, or audio-visual mismatches.
• Write specific English explanations pointing to what was seen or heard.

Skills

Fluent English

Attention to detail

Clear communication

Explanations writing

Decision making

Bachelor's degree

Education

Bachelor's degree or higher

Job description

Outlier, powered by Scale AI, is seeking detail-oriented English speakers to review AI-generated media. You will play out live conversations with an AI voice model and assess how natural each exchange sounds.

You will compare AI-generated images and videos, judge prompt adherence, and explain issues in writing. Contributors work remotely on a flexible schedule, earning hourly pay with weekly payouts and performance incentives, plus access to leading LLMs.