Remote AI Content Evaluator — Shape Real-World AI

Scale AI

City of Moncton

Remote

CAD 24,000 - 34,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Work flexible from anywhere
Free access to leading LLMs
Join 900K+ Outlier Experts globally
Collaborate with AI researchers

Job summary

Outlier, a Scale AI company, invites detail-oriented English speakers to evaluate AI-generated media. You will roleplay conversations, compare image and video outputs, and write concise explanations of any issues.

This is a 1099 contract, remote work with a flexible schedule, and weekly payments. Ideal candidates are fluent in English, detail-oriented, and able to make clear decisions when both options have flaws.

Qualifications

  • Fluent English with strong written communication.
  • Experience writing concise, evidence-based reviews.
  • Willingness to work remotely on a flexible schedule.

Responsibilities

  • Hold live, scenario-based conversations in English with AI voice models.
  • Rank naturalness and usefulness, compare AI outputs to prompts.
  • Explain in writing what looked or sounded wrong.
  • Rate outputs across adherence, quality, and realism with written explanations.

Skills

Attention to detail
Clear written communication
Comfortable rapid thinking
Decision making under ambiguity

Education

Bachelor's degree

Job description

Outlier, a Scale AI company, invites detail-oriented English speakers to evaluate AI-generated media. You will roleplay conversations, compare image and video outputs, and write concise explanations of any issues.

This is a 1099 contract, remote work with a flexible schedule, and weekly payments. Ideal candidates are fluent in English, detail-oriented, and able to make clear decisions when both options have flaws.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Scale AI • Calgary

Remote
CAD 24,000 - 34,000
Flexible schedule
Free access to leading LLMs
Join 900K+ Outlier Experts across 52+%
Remote AI Quality Evaluator – English
Remote AI Quality Evaluator – English

Scale AI • Ajax

Remote
CAD 24,000 - 34,000
Flexible schedule
Weekly payments
Access to leading LLMs
+1
Remote AI Evaluation Specialist - Images & Videos
Remote AI Evaluation Specialist - Images & Videos

Scale AI • Guelph

Remote
CAD 24,000 - 34,000
Flexible schedule
Free access to leading LLMs
Join 900K+ Outlier Experts across 52+,
+1
Remote AI Content Evaluator & Model Feedback Specialist
Remote AI Content Evaluator & Model Feedback Specialist

Scale AI • Airdrie

Remote
CAD 17,000 - 29,000
Flexible schedule
Remote work
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Scale AI • Barrie

Hybrid
CAD 24,000 - 34,000
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Scale AI • Summerside

Remote
CAD 24,000 - 34,000
Work from anywhere
Free access to leading LLMs
Join 900K+ Outlier Experts across 52+"
Remote AI Content Evaluator & Feedback Specialist
Remote AI Content Evaluator & Feedback Specialist

Scale AI • Belleville

Remote
CAD 24,000 - 34,000
Work flexible schedule
Free access to LLMs
Global expert network
+1
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Scale AI • Vancouver

Hybrid
CAD 24,000 - 34,000
Flexible schedule
Free access to leading LLMs
Global expert community
Remote AI Evaluation Specialist — Flexible Freelance
Remote AI Evaluation Specialist — Flexible Freelance

Scale AI • Kelowna

Hybrid
CAD 24,000 - 34,000
Flexible schedule
Freelance contractor
Weekly payments
+1
Remote AI Content Evaluator — Flexible Hours
Remote AI Content Evaluator — Flexible Hours

Outlier • Saanich

Remote
CAD 24,000 - 34,000
Free access to leading LLMs
Flexible hours and remote work
Weekly payments