Remote AI Media Evaluator — Spot What’s Off (Flexible)

Outlier

Wilmington (NC)

Remote

USD 20,000 - 29,000

Part time

25 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible hours
Remote work
Free LLM access
Incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media by holding live conversations with an AI voice model and scoring each exchange, comparing generated images and videos to judge which follows the prompt better, and explaining in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason, learn, and improve, contributing to frontier research and real-world performance.

Qualifications

  • Fluent English speaker with clear written communication.
  • Strong attention to detail and patience to replay or zoom in when something seems off.
  • Comfortable thinking on your feet and explaining realistic scenarios clearly.
  • Experience writing short, evidence-based explanations or reviews.
  • Able to decide clearly when both options have flaws.

Responsibilities

  • Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
  • Comparing AI-generated images and videos and judging adherence to prompts.
  • Inspecting outputs closely to spot issues like artifacts, motion issues, or text/audio mismatches.
  • Writing concise explanations in English pointing to what was observed.

Skills

Fluent English
Attention to detail
Think on feet
Explain reviews
Decision making (ambiguity)

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media by holding live conversations with an AI voice model and scoring each exchange, comparing generated images and videos to judge which follows the prompt better, and explaining in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason, learn, and improve, contributing to frontier research and real-world performance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Media Evaluator — Spot What's Off & Earn
Remote AI Media Evaluator — Spot What's Off & Earn

Outlier • Saint Petersburg (FL)

Remote
USD 20,000 - 29,000
Weekly payments via ACH/PayPal
Remote work from anywhere
Free access to leading LLMs
+1
Remote AI Media Evaluator — Spot What's Off
Remote AI Media Evaluator — Spot What's Off

Outlier • Harrisburg

Remote
USD 20,000 - 29,000
Flexible hours
Remote work
Free access to leading LLMs
+1
Remote AI Media Evaluator: Spot What’s Off in Videos
Remote AI Media Evaluator: Spot What’s Off in Videos

Outlier • Fayetteville (AR)

Remote
USD 20,000 - 29,000
Earn up to $18 USD/hr - Plus bonuses
Flexible hours - no minimum hours
Free access to leading LLMs
Remote AI Media Evaluator — Spot Flaws & Explain
Remote AI Media Evaluator — Spot Flaws & Explain

Outlier • Bloomington (IN)

Remote
USD 15,000 - 25,000
Flexible hours
Remote work
Free access to leading LLMs
Remote AI Media Evaluator — Spot Flaws & Give Insights
Remote AI Media Evaluator — Spot Flaws & Give Insights

Outlier • Des Moines (IA)

Remote
USD 20,000 - 29,000
Flexible work from home
Free access to leading LLMs
Weekly payments
Remote AI Media Evaluator — Spot AI Errors & Compare
Remote AI Media Evaluator — Spot AI Errors & Compare

Outlier • Tampa (FL)

Remote
USD 12,000 - 21,000
Paid weekly
Free access to leading LLMs
Fully remote
Remote AI Media Evaluator | Spot AI Gaps in Images & Audio
Remote AI Media Evaluator | Spot AI Gaps in Images & Audio

Outlier • Auburn (AL)

Remote
USD 12,000 - 21,000
Flexible schedule
Weekly payments
Remote work from anywhere
+2
Remote AI Media Evaluator — Spot Flaws & Explain
Remote AI Media Evaluator — Spot Flaws & Explain

Outlier • Wichita (KS)

Hybrid
USD 20,000 - 29,000
Free access to leading LLMs
Weekly payments via ACH, PayPal andAir
Flexible hours
Remote AI Media Evaluator — Spot Flaws & Explain
Remote AI Media Evaluator — Spot Flaws & Explain

Outlier • Chandler (AZ)

Remote
USD 20,000 - 29,000
Earn up to $18 USD/hr
Flexible hours
Free access to leading LLMs
+1
Remote AI Media Evaluator — Spot Issues & Improve Models
Remote AI Media Evaluator — Spot Issues & Improve Models

Outlier • Greenville (SC)

Remote
USD 15,000 - 25,000
Earn up to $18 USD/hr
Flexible hours
Free access to leading LLMs
+1