Remote AI Output Evaluator – Live Dialog & Media Review

Scale AI; Ajax; Remote; CAD 24,000 - 34,000; Part time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert community

Job summary

Outlier, owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media, score exchanges with an AI voice model, and explain issues in writing. You can work remotely on your own schedule, reviewing images, videos, captions, and audio tasks across various projects.

The role emphasizes careful observation, clear written feedback, and the ability to decide when prompts or outputs fail to meet expectations. Ideal for strong English writers with attention to detail.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in.
• Comfortable thinking on your feet and discussing real scenarios.
• Experience writing concise, evidence-based explanations.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Holding live, scenario-based English conversations with AI voice models.
• Ranking naturalness, usefulness, and clarity of outputs.
• Comparing AI-generated images and videos for prompt adherence.
• Explaining in writing what looked or sounded off.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable improvising

Evidence-based explanations

Decision making with trade-offs

Education

Bachelor’s degree or above

Job description

Outlier, owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media, score exchanges with an AI voice model, and explain issues in writing. You can work remotely on your own schedule, reviewing images, videos, captions, and audio tasks across various projects.

The role emphasizes careful observation, clear written feedback, and the ability to decide when prompts or outputs fail to meet expectations. Ideal for strong English writers with attention to detail.