AI Evaluation Specialist - English (Remote Flexible)

Scale AI

Edmonton

Remote

CAD 24,000 - 34,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible schedule
Free access to leading LLMs
Global expert community

Job summary

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media on a flexible schedule. You will roleplay live conversations with an AI voice model, rank outputs for naturalness and usefulness, and write concise explanations in English.

This is a remote freelance opportunity with payments processed weekly. Applicants from Australia, Canada, Ireland, New Zealand, United Kingdom, and the United States are welcome to apply, with Canada-based contributors being

Qualifications

  • Fluent English speaker with strong written communication.
  • Excellent attention to detail and patience to replay or zoom in when something seems off.
  • Able to think on your feet and discuss realistic scenarios naturally.
  • Experience writing concise, evidence-based explanations or reviews.
  • Able to decide clearly when both options have flaws.

Responsibilities

  • Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
  • Compare AI-generated images and videos and judge adherence to prompts.
  • Inspect outputs closely and note issues like distortion, flicker, or mismatched audio/video.
  • Write detailed explanations in English highlighting observed issues.

Skills

Fluent English
Attention to detail
Clear written communication
Evidence-based reviews
Decision making with imperfect options

Education

Bachelor's degree or above (nice to have)

Job description

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media on a flexible schedule. You will roleplay live conversations with an AI voice model, rank outputs for naturalness and usefulness, and write concise explanations in English.

This is a remote freelance opportunity with payments processed weekly. Applicants from Australia, Canada, Ireland, New Zealand, United Kingdom, and the United States are welcome to apply, with Canada-based contributors being

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Specialist - Flexible Hours
Remote AI Evaluation Specialist - Flexible Hours

Scale AI • Prince Albert

Hybrid
CAD 24,000 - 34,000
Free access to leading LLMs
Join 900K+ Outlier Experts across 52+?
AI Evaluation Specialist - Remote & Flexible
AI Evaluation Specialist - Remote & Flexible

Scale AI • Brampton

Hybrid
CAD 17,000 - 29,000
Free access to leading LLMs
Flexible schedule, no minimum hours
Global community of experts
AI Evaluation Specialist - Remote & Flexible
AI Evaluation Specialist - Remote & Flexible

Scale AI • Outaouais

Hybrid
CAD 24,000 - 34,000
Flexible schedule
Weekly payments via PayPal / ACH
Up to $15/hour + incentives
+1
AI Evaluation & Feedback Specialist - Remote
AI Evaluation & Feedback Specialist - Remote

Scale AI • Greater Sudbury

Remote
CAD 24,000 - 34,000
Flexible schedule
Weekly payouts
Free access to leading LLMs
AI Evaluation Specialist - Remote & Flexible
AI Evaluation Specialist - Remote & Flexible

Outlier • Moose Jaw

Hybrid
CAD 23,000 - 39,000
Free access to leading LLMs
Weekly payments
Flexible hours
+1
AI Evaluation Specialist (English) — Remote & Flexible
AI Evaluation Specialist (English) — Remote & Flexible

Outlier • Aurora

Remote
CAD 24,000 - 34,000
AI Evaluation Specialist - Remote, Flexible Hours
AI Evaluation Specialist - Remote, Flexible Hours

Scale AI • Dartmouth

Hybrid
CAD 24,000 - 34,000
Flexible schedule
Free access to leading LLMs
Global expert community
+1
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Scale AI • Summerside

Remote
CAD 24,000 - 34,000
Work from anywhere
Free access to leading LLMs
Join 900K+ Outlier Experts across 52+"
AI Evaluation Specialist — Remote & Flexible Hours
AI Evaluation Specialist — Remote & Flexible Hours

Outlier • Southwestern Ontario

Remote
CAD 17,000 - 29,000
Pay up to $15 USD/hr
Missions surge pricing
Flexible hours
+2
AI Evaluation Specialist - Remote & Flexible Hours
AI Evaluation Specialist - Remote & Flexible Hours

Outlier • Fredericton

Hybrid
CAD 24,000 - 34,000
Flexible hours
Remote work from anywhere
Free access to leading LLMs