AI Evaluation Specialist — Remote Media QA

Scale AI

San Juan de Terranova

Remote

CAD 24,000 - 34,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible schedule
Free LLM access
Global experts network
Collaborative environment

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail‑oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, and explain what looked or sounded off, all remotely and on your own schedule.

The role supports flexible work from anywhere with weekly payments and performance incentives. You’ll review images, videos, captions, and audio quality, providing evidence-based feedback to help improve AI systems.

Qualifications

  • Fluent English with clear written communication.
  • Strong attention to detail and ability to replay or zoom in when something seems off.
  • Comfortable speaking in natural conversations and thinking on your feet.
  • Experience writing brief, evidence-based explanations or reviews.
  • Bachelor’s degree or above preferred.

Responsibilities

  • Hold live English conversations with AI voice models and rate naturalness and usefulness.
  • Compare AI-generated images and videos to assess adherence to prompts.
  • Inspect outputs for issues like distortion or misalignment and document findings.
  • Write concise explanations highlighting observed issues.

Skills

Fluent English
Attention to detail
Clear written communication
Live conversations with AI
Independent work

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail‑oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, and explain what looked or sounded off, all remotely and on your own schedule.

The role supports flexible work from anywhere with weekly payments and performance incentives. You’ll review images, videos, captions, and audio quality, providing evidence-based feedback to help improve AI systems.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Evaluation Specialist — Chat & Media QA
AI Evaluation Specialist — Chat & Media QA

Scale AI • Milton

Remote
CAD 24,000 - 34,000
Free access to leading LLMs
Global freelance community
Weekly payments
AI Writing & Media Quality Evaluator — Remote
AI Writing & Media Quality Evaluator — Remote

Scale AI • Kelowna

Remote
CAD 24,000 - 34,000
Flexible schedule
Free access to leading LLMs
AI Writing & Media Evaluator — Remote & Flexible
AI Writing & Media Evaluator — Remote & Flexible

Scale AI • Yellowknife

Remote
CAD 17,000 - 29,000
Flexible schedule
Free access to leading LLMs (worth $0+
Global community of 900K+ experts
Remote AI Quality Evaluator & Feedback Specialist
Remote AI Quality Evaluator & Feedback Specialist

Scale AI • Summerside

Hybrid
CAD 17,000 - 29,000
Flexible schedule
Remote work
Free access to leading LLMs
+1
Remote AI Media Evaluator — Image & Audio QA
Remote AI Media Evaluator — Image & Audio QA

Outlier • Sherwood Park

Remote
CAD 29,000 - 41,000
Hourly pay up to $18
Flexible work from anywhere
Free access to leading LLMs
+1
AI Evaluation Specialist — Remote & Flexible Hours
AI Evaluation Specialist — Remote & Flexible Hours

Outlier • Southwestern Ontario

Remote
CAD 17,000 - 29,000
Pay up to $15 USD/hr
Missions surge pricing
Flexible hours
+2
Remote AI Evaluation & Feedback Specialist
Remote AI Evaluation & Feedback Specialist

Scale AI • Chestermere

Hybrid
CAD 25,000 - 33,000
Flexible schedule
Work from anywhere
Free access to leading LLMs
Remote AI Content Evaluation Specialist
Remote AI Content Evaluation Specialist

Scale AI • Town of Cochrane

Remote
CAD 24,000 - 34,000
Flexible schedule
Weekly payments
Free access to leading LLMs
Remote AI Media Evaluator & Quality Feedback Specialist
Remote AI Media Evaluator & Quality Feedback Specialist

Scale AI • Markham

Remote
CAD 24,000 - 34,000
Flexible schedule
Free access to leading LLMs
Global expert network
+1
Remote AI Content Quality Analyst
Remote AI Content Quality Analyst

Scale AI • Brandon

Remote
CAD 17,000 - 29,000
Flexible schedule
Free access to leading LLMs
Global expert community