AI Output Quality Evaluator — Remote

Scale AI; Vernon; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Weekly payments

Access to leading LLMs

Job summary

Scale AI’s Outlier platform seeks detail-oriented English speakers to review AI-generated media remotely. You will rule on accuracy, realism, and prompt adherence by comparing media and describing what was off in clear English.

Work is freelance, with flexible scheduling and weekly payments. Ideal candidates have strong written communication, high attention to detail, and the ability to decide decisively when trade-offs exist.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and patience to review closely.
• Ability to think on your feet and discuss realistic scenarios.
• Experience writing concise, evidence-based reviews.
• Able to decide clearly when options have flaws.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness.
• Comparing AI-generated images and videos and judging prompt adherence.
• Inspecting outputs closely to spot problems like artifacts or misalignment.
• Rating each output and writing explanations in English with specifics.

Skills

Fluent English

Attention to detail

Think on your feet

Evidence-based reviews

Clear decision making

Bachelor’s degree (nice to have)

Education

Bachelor’s degree or higher (nice to have)

Job description

Scale AI’s Outlier platform seeks detail-oriented English speakers to review AI-generated media remotely. You will rule on accuracy, realism, and prompt adherence by comparing media and describing what was off in clear English.

Work is freelance, with flexible scheduling and weekly payments. Ideal candidates have strong written communication, high attention to detail, and the ability to decide decisively when trade-offs exist.