Remote AI Media Evaluator - Live Chats & Quality Feedback

Outlier

Toronto

Remote

CAD 29,000 - 41,000

Full time

5 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Earn up to $18 USD/hr
Flexible schedule - work from anywhere
Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score each exchange, compare generated images and videos to judge which follows the prompt, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve.

Qualifications

  • Fluent English with clear written communication.
  • Detail-oriented with the ability to replay/zoom in when something seems off.
  • Bachelor's degree or above is preferred.
  • Ability to explain what looked or sounded wrong in writing.
  • Clear decision making when both options have flaws.
  • Experience writing short, evidence-based explanations or reviews.

Responsibilities

  • Holding live, scenario-based conversations in English with AI voice models, then ranking naturalness and usefulness.
  • Comparing AI-generated images and videos and judging alignment with the prompt.
  • Inspecting outputs closely, including zooming in and replaying, to spot problems like distortions or audio-video mismatch.
  • Writing specific English explanations that point to what you saw or heard.

Skills

Fluent English
Attention to detail
Clear written communication
Decision making under ambiguity
Experience writing reviews

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score each exchange, compare generated images and videos to judge which follows the prompt, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Media Evaluator — Live Conversations & Reviews
Remote AI Media Evaluator — Live Conversations & Reviews

Outlier • Belleville

Remote
CAD 21,000 - 35,000
Flexible hours
Remote work
Free access to leading LLMs
+1
Remote AI Media Evaluator — Live Voices & Video Reviews
Remote AI Media Evaluator — Live Voices & Video Reviews

Outlier • City of Moncton

Remote
CAD 29,000 - 41,000
Flexible schedule
Remote work from anywhere
Free access to leading LLMs
+1
Remote AI Media Evaluator - Video & Voice Quality
Remote AI Media Evaluator - Video & Voice Quality

Outlier • St. Albert

Remote
CAD 21,000 - 35,000
Up to $18 USD/hr
Weekly payments
Free access to leading LLMs
Remote AI Media Evaluator — Image & Video
Remote AI Media Evaluator — Image & Video

Outlier • Dartmouth

Remote
CAD 29,000 - 41,000
Earn up to $18 USD/hr
Flexible hours
Free access to leading LLMs
+1
Remote AI Quality Evaluator - English
Remote AI Quality Evaluator - English

Outlier • Burnaby

Remote
CAD 19,000 - 29,000
Free access to leading LLMs
Weekly payments
Remote work
+1
Remote AI Media Quality Evaluator
Remote AI Media Quality Evaluator

Outlier • Burnaby

Remote
CAD 23,000 - 35,000
Fully remote
Flexible hours
Weekly payments
+1
Remote AI Media Evaluator: Video & Image QA
Remote AI Media Evaluator: Video & Image QA

Outlier • Saskatoon

Remote
CAD 21,000 - 35,000
Remote work
Flexible hours
Weekly payments
+1
Remote AI Media Quality Evaluator
Remote AI Media Quality Evaluator

Outlier • Ottawa

Remote
CAD 23,000 - 29,000
Weekly payments
Free access to LLMs
Flexible schedule
+1
Remote AI Media Evaluator: Voice & Video
Remote AI Media Evaluator: Voice & Video

Outlier • Fort McMurray

Remote
CAD 17,000 - 29,000
Flexible hours
Remote work
Access to leading LLMs
Remote AI Evaluator (English) – Live QA & Review
Remote AI Evaluator (English) – Live QA & Review

Outlier • Calgary

Remote
CAD 19,000 - 29,000
Free access to leading LLMs
Earn up to $15 USD/hr
Weekly payments