Remote AI Evaluation Specialist — Language & Media

Scale AI

Coquitlam

Remote

CAD 17,000 - 29,000

Part time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Scale AI’s Outlier platform seeks detail-oriented English speakers to review AI-generated media and rate conversational quality. You will roleplay live conversations with an AI voice model, compare AI images and videos, and explain in writing what looked off.

As a freelance contractor on Outlier, you’ll set your own schedule, work remotely, and earn up to USD $15 per hour plus incentives. Applicants from multiple countries are encouraged to apply.

Qualifications

  • Fluent English speaker with strong, clear written communication.
  • Excellent attention to detail, with the patience to look and listen closely, and to replay or zoom in when something seems off.
  • Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way.
  • Experience writing short, evidence-based explanations or reviews.
  • Able to make clear decisions when both options have flaws.
  • Bachelor’s degree or higher preferred.

Responsibilities

  • Hold live, scenario-based conversations in English with AI voice models and rate naturalness.
  • Compare AI-generated images and videos to judge prompt adherence.
  • Inspect outputs for distortions, artifacts, and audio-video mismatches.
  • Write concise explanations in English pointing to observed issues.

Skills

Fluent English
Attention to detail
Clear written communication
Evidence-based writing
Decision making under ambiguity
Bachelor’s degree preferred

Education

Bachelor’s degree or higher

Job description

Scale AI’s Outlier platform seeks detail-oriented English speakers to review AI-generated media and rate conversational quality. You will roleplay live conversations with an AI voice model, compare AI images and videos, and explain in writing what looked off.

As a freelance contractor on Outlier, you’ll set your own schedule, work remotely, and earn up to USD $15 per hour plus incentives. Applicants from multiple countries are encouraged to apply.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Scale AI • Summerside

Remote
CAD 17,000 - 29,000
Free access to leading LLMs
Flexible schedule
High-earning potential with incentives
Remote AI Language Evaluation Specialist
Remote AI Language Evaluation Specialist

Scale AI • Calgary

Remote
CAD 24,000 - 34,000
Flexible schedule
Free access to leading LLMs
Global community of experts
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Scale AI • West Kelowna

Remote
CAD 24,000 - 34,000
Flexible schedule
Free access to leading LLMs
Remote AI Language Evaluation Specialist
Remote AI Language Evaluation Specialist

Scale AI • Whitby

Remote
CAD 25,000 - 33,000
Flexible schedule
Freelance/1099 contract
Free access to leading LLMs worth $200
+1
Remote AI Dialogue Evaluation Specialist
Remote AI Dialogue Evaluation Specialist

Scale AI • Southwestern Ontario

Remote
CAD 17,000 - 29,000
Flexible schedule
Free access to leading LLMs
Join 900K+ Outlier Experts
Remote AI Media & Conversation Evaluator
Remote AI Media & Conversation Evaluator

Scale AI • Belleville

Remote
CAD 17,000 - 29,000
Free access to leading LLMs
Remote AI Evaluation Specialist (Freelance)
Remote AI Evaluation Specialist (Freelance)

Scale AI • Saint-Eustache

Hybrid
CAD 24,000 - 34,000
Flexible schedule
Remote work from anywhere
Free access to leading LLMs
+1
Remote AI Evaluation & Annotation Specialist
Remote AI Evaluation & Annotation Specialist

Scale AI • City of Leduc

Remote
CAD 24,000 - 34,000
Flexible schedule
Weekly payments
Freelance/1099 contract
Remote AI Evaluation Specialist (Freelance)
Remote AI Evaluation Specialist (Freelance)

Scale AI • Windsor

Remote
CAD 24,000 - 34,000
Free access to leading LLMs
Flexible schedule
Remote AI Evaluation Specialist – Fluent English
Remote AI Evaluation Specialist – Fluent English

Outlier • Ajax

Remote
CAD 17,000 - 29,000