Remote AI Evaluation Specialist

Scale AI; Vancouver; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Free access to leading LLMs

Job summary

Outlier is an AI evaluation platform operated with Scale AI. We seek English speakers to review AI-generated media by engaging in live conversations with AI voice models, comparing AI outputs, and writing detailed feedback on performance.

Work remotely with a flexible schedule. You can contribute across various tasks, including image, video, and audio evaluations, while earning hourly pay and potential bonuses through project incentives.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and the ability to replay or zoom in.
• Comfortable thinking on your feet and discussing realistic situations.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Hold live English conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs for distortion, flicker, out-of-sync audio/video and write explanations in English.
• Provide concise, evidence-based explanations of observations.

Skills

Fluent English

Attention to detail

Written communication

Decision making

Education

Bachelor's degree or higher

Job description

Outlier is an AI evaluation platform operated with Scale AI. We seek English speakers to review AI-generated media by engaging in live conversations with AI voice models, comparing AI outputs, and writing detailed feedback on performance.

Work remotely with a flexible schedule. You can contribute across various tasks, including image, video, and audio evaluations, while earning hourly pay and potential bonuses through project incentives.