AI Evaluation Specialist - Live Dialog & Media Review

Scale AI; Sorel-Tracy; À distance; CAD 24 000 - 34 000; Plein temps

Avantages offerts par ce poste

Flexible schedule

Free access to leading LLMs

Global expert community

Résumé du poste

Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges. You will compare AI-generated images and videos, judge prompt adherence, and explain what looked or sounded off in writing, all remotely and on your own schedule.

You will help shape how advanced AI systems reason and learn by providing structured feedback through Outlier’s evaluation loop.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and ability to replay or zoom in when needed.
• Comfortable thinking on your feet and discussing realistic scenarios.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to make clear decisions even when both options have flaws.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsabilités

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to identify issues like distortions, flicker, or audio-video mismatches.
• Provide written explanations of findings focusing on observed evidence.

Connaissances

Fluent English

Attention to detail

Clear spoken communication

Evidence-based explanations

Decisive under ambiguity

Bachelor’s degree (nice to have)

Formation

Bachelor’s degree or above

Description du poste

Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges. You will compare AI-generated images and videos, judge prompt adherence, and explain what looked or sounded off in writing, all remotely and on your own schedule.

You will help shape how advanced AI systems reason and learn by providing structured feedback through Outlier’s evaluation loop.