AI Evaluation Specialist - Remote & Flexible

Scale AI; Outaouais; Híbrido; CAD 24.000 - 34.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible schedule

Weekly payments via PayPal / ACH

Up to $15/hour + incentives

Free access to leading LLMs

Descripción de la vacante

Outlier, operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate naturalness and usefulness, and explain issues in writing from home on your own schedule.

You will inspect AI outputs, compare two images/videos, and provide concise explanations of flaws while adhering to prompts and quality standards.

Formación

• Fluent English with strong written communication.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Able to think on your feet and discuss realistic scenarios.
• Experience writing short, evidence-based explanations or reviews.
• Capable of making a clear decision when both options have flaws.

Responsabilidades

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely to spot issues like distorted anatomy, flickering or mismatched audio/video.
• Provide written explanations pointing to what you saw or heard, in English.

Conocimientos

Fluent English

Attention to detail

Think on your feet

Evidence-based writing

Decision making under flaws

Bachelor’s degree (nice to have)

Educación

Bachelor's degree or above

Descripción del empleo

Outlier, operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate naturalness and usefulness, and explain issues in writing from home on your own schedule.

You will inspect AI outputs, compare two images/videos, and provide concise explanations of flaws while adhering to prompts and quality standards.