Remote AI Evaluation & QA Specialist

Scale AI; Maple Ridge; Remote; CAD 19,000 - 29,000; Full time

Job summary

Scale AI is seeking detail-oriented English speakers to review AI-generated media and rate exchanges with AI voice models. You will compare images and videos, judge how well they follow prompts, and write concise explanations that highlight issues you observed, all from a remote setting.

You’ll work on tasks like image and video evaluations, caption labeling, and audio assessments, with a flexible schedule and a freelance, 1099 contract structure.

Qualifications

• Fluent English and strong written communication are essential.
• Excellent attention to detail and the ability to explain decisions clearly.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to spot problems (anatomy, motion, text, audio).
• Provide written explanations detailing what you saw or heard for each task.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under uncertainty

Education

Bachelor’s degree or above

Job description

Scale AI is seeking detail-oriented English speakers to review AI-generated media and rate exchanges with AI voice models. You will compare images and videos, judge how well they follow prompts, and write concise explanations that highlight issues you observed, all from a remote setting.

You’ll work on tasks like image and video evaluations, caption labeling, and audio assessments, with a flexible schedule and a freelance, 1099 contract structure.