Remote AI Image & Video Evaluation Specialist

Scale AI; Markham; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global community of experts

Collaborative projects with AI teams

Job summary

Scale AI’s Outlier platform seeks detail-oriented English speakers to rate and evaluate AI-generated media. You will roleplay live conversations with AI voice models, compare images/videos to prompts, and provide written explanations of observed issues, all on your own schedule and remotely.

Ideal candidates have strong English writing, meticulous attention to detail, and the ability to decide between imperfect options.

Qualifications

• Fluent English with strong written communication.
• High attention to detail and careful review.
• Able to think on your feet and articulate decisions clearly.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models.
• Rank naturalness and usefulness of responses; compare AI-generated media against prompts.
• Inspect outputs for issues like distortions, errors, or misalignment and explain findings in writing.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based writing

Decision making under imperfect info

Bachelor’s degree (nice to have)

Education

Bachelor’s degree (preferred)

Tools

Resume

LinkedIn profile

Job description

Scale AI’s Outlier platform seeks detail-oriented English speakers to rate and evaluate AI-generated media. You will roleplay live conversations with AI voice models, compare images/videos to prompts, and provide written explanations of observed issues, all on your own schedule and remotely.

Ideal candidates have strong English writing, meticulous attention to detail, and the ability to decide between imperfect options.