Remote AI Quality Evaluator — Data & Media Review

Scale AI; Mississauga; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Job summary

Scale AI, via Outlier, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate exchanges, compare AI outputs, and write concise explanations of observed issues from home.

Ideal candidates have strong English writing, sharp attention to detail, and comfort with rapid decision-making. Flexible freelance opportunities offer remote work with weekly payment options and access to leading LLMs.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and patience to review tasks carefully.
• Comfortable thinking on your feet and explaining decisions.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to spot distortions, flicker, text/audio mismatches.
• Write clear explanations in English detailing observations and reasoning.

Skills

Fluent English

Attention to detail

Clear written communication

Shorthand decision making

Evidence-based writing

Education

Bachelor’s degree or above

Job description

Scale AI, via Outlier, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate exchanges, compare AI outputs, and write concise explanations of observed issues from home.

Ideal candidates have strong English writing, sharp attention to detail, and comfort with rapid decision-making. Flexible freelance opportunities offer remote work with weekly payment options and access to leading LLMs.