Remote AI Content Evaluator & Feedback Specialist

Scale AI

Belleville

Remote

CAD 24,000 - 34,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Work flexible schedule
Free access to LLMs
Global expert network
Collaborate with experts

Job summary

Scale AI-owned Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain discrepancies in writing, all remotely on your own schedule.

As part of Outlier’s evaluation loop, you’ll compare AI outputs, rate adherence and realism, and provide concise, evidence-based explanations. This freelance role offers flexible hours and weekly payments to contributors worldwide.

Qualifications

  • Fluent English with strong written communication.
  • Excellent attention to detail and careful listening.
  • Comfortable discussing realistic scenarios in conversation.
  • Experience writing concise, evidence-based reviews.
  • Ability to decide clearly when options have flaws.
  • Bachelor’s degree or higher preferred.

Responsibilities

  • H​old live, scenario-based English conversations with AI voice models.
  • Rank naturalness, usefulness, and clarity of responses.
  • Compare AI-generated images and videos to assess prompt adherence.
  • Explain what looked or sounded wrong in writing, with examples.

Skills

Fluent English
Attention to detail
Clear written communication
Able to think on feet
Evidence-based explanations

Education

Bachelor's degree or above

Job description

Scale AI-owned Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain discrepancies in writing, all remotely on your own schedule.

As part of Outlier’s evaluation loop, you’ll compare AI outputs, rate adherence and realism, and provide concise, evidence-based explanations. This freelance role offers flexible hours and weekly payments to contributors worldwide.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Evaluation & Feedback Specialist
Remote AI Evaluation & Feedback Specialist

Scale AI • Coquitlam

Remote
CAD 24,000 - 34,000
Remote AI Content Evaluator & Model Feedback Specialist
Remote AI Content Evaluator & Model Feedback Specialist

Scale AI • Airdrie

Remote
CAD 17,000 - 29,000
Flexible schedule
Remote work
Remote AI Media Evaluator & Feedback Specialist
Remote AI Media Evaluator & Feedback Specialist

Scale AI • Yellowknife

Remote
CAD 17,000 - 29,000
Flexible schedule
Free access to leading LLMs
Join 900K+ Outlier Experts across many
+1
Remote AI Evaluation & Quality Feedback Specialist
Remote AI Evaluation & Quality Feedback Specialist

Scale AI • Richmond Hill

Remote
CAD 17,000 - 29,000
Free access to leading LLMs
Flexible schedule
Global expert network
Remote AI Evaluation Specialist
Remote AI Evaluation Specialist

Scale AI • Summerside

Remote
CAD 24,000 - 34,000
Work from anywhere
Free access to leading LLMs
Join 900K+ Outlier Experts across 52+"
Remote AI Evaluation & Feedback Specialist
Remote AI Evaluation & Feedback Specialist

Outlier • Medicine Hat

Remote
CAD 24,000 - 34,000
Remote AI Content Evaluator & Feedback Specialist
Remote AI Content Evaluator & Feedback Specialist

Scale AI • Listowel

Hybrid
CAD 24,000 - 34,000
Flexible schedule
Weekly payments (USD)
Free access to leading LLMs
Remote AI Quality Evaluator & Feedback Specialist
Remote AI Quality Evaluator & Feedback Specialist

Scale AI • Ajax

Remote
CAD 24,000 - 34,000
Flexible schedule
Free LLM access
Remote: AI Content Evaluator & Feedback Specialist
Remote: AI Content Evaluator & Feedback Specialist

Scale AI • Cambridge

Remote
CAD 24,000 - 34,000
Flexible schedule
Free access to leading LLMs
Join 900K+ Outlier Experts
Remote AI Evaluator & Model Feedback Specialist
Remote AI Evaluator & Model Feedback Specialist

Scale AI • Maple Ridge

Remote
CAD 24,000 - 34,000
Flexible schedule
Weekly payments
Free access to leading LLMs
+1