AI Evaluation Specialist — Live Dialogues & Media Reviews

Outlier; Saskatoon; Hybrid; CAD 19,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work from home

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of their home with flexible hours. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked or sounded off in writing.

Work remotely on your schedule with pay per project. As part of Outlier's evaluation loop, your insights help translate frontier research into practical AI that performs better in real-world tasks.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and ability to explain observations.
• Comfortable thinking on your feet and discussing realistic scenarios.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models.
• Ranking how natural and clear each output sounds.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
• Rating outputs across dimensions and writing explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Articulate reasoning

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of their home with flexible hours. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked or sounded off in writing.

Work remotely on your schedule with pay per project. As part of Outlier's evaluation loop, your insights help translate frontier research into practical AI that performs better in real-world tasks.