Remote AI Media Evaluator: Spot Flaws & Judge Outputs

Outlier

Jersey City (NJ)

Remote

USD 12,000 - 21,000

Part time

41 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Weekly payments
Remote work
Access to leading LLMs
Flexible hours

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will host live conversations with an AI voice model and assess how well responses follow prompts, scoring both audio and visuals remotely on your schedule.

This freelance, 1099 role offers flexible hours, weekly payments, and access to leading LLMs. Applicants from the United States and other listed countries can apply.

Qualifications

  • Fluent English speaker with clear written communication.
  • Great attention to detail and willingness to replay or zoom in when something seems off.
  • Bachelor’s degree or above preferred.
  • Able to think on your feet and discuss realistic scenarios.
  • Experience writing short, evidence-based explanations.
  • Able to make a clear decision when both options have flaws.

Responsibilities

  • Holding a live, scenario-based conversation in English with AI voice models.
  • Ranking how natural, useful, and clear each one sounded.
  • Comparing AI-generated images and videos and judging which one better follows the prompt.
  • Spotting problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
  • Writing explanations in English that point to what you saw or heard.

Skills

Fluent English
Attention to detail
Clear written communication
Decision making

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will host live conversations with an AI voice model and assess how well responses follow prompts, scoring both audio and visuals remotely on your schedule.

This freelance, 1099 role offers flexible hours, weekly payments, and access to leading LLMs. Applicants from the United States and other listed countries can apply.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Media Evaluator: Spot Flaws & Explain
Remote AI Media Evaluator: Spot Flaws & Explain

Outlier • Cape Coral (FL)

Remote
USD 17,000 - 24,000
Flexible hours
Remote work
Weekly pay via ACH/PayPal/AirTM
+1
Remote AI Media Evaluator — Spot Flaws & Give Feedback
Remote AI Media Evaluator — Spot Flaws & Give Feedback

Outlier • Akron (OH)

Remote
USD 17,000 - 24,000
Flexible hours
Remote work from anywhere
Free access to leading LLMs
+1
Remote AI Media Evaluator — Spot Flaws & Improve AI
Remote AI Media Evaluator — Spot Flaws & Improve AI

Outlier • Aurora (CO)

Remote
USD 12,000 - 21,000
Free access to leading LLMs
Weekly payments (ACH/PayPal/AirTM)
Fully remote work
Remote AI Media Evaluator: Spot Flaws & Improve Models
Remote AI Media Evaluator: Spot Flaws & Improve Models

Outlier • Blacksburg (VA)

Remote
USD 17,000 - 24,000
Flexible hours
Remote work
Free access to LLMs
+1
Remote AI Media Evaluator — Spot Flaws & Improve AI
Remote AI Media Evaluator — Spot Flaws & Improve AI

Outlier • Fort Collins (CO)

Remote
USD 12,000 - 21,000
Free access to leading LLMs
Flexible hours
Remote work
Remote AI Media Evaluator — Spot Flaws & Improve AI
Remote AI Media Evaluator — Spot Flaws & Improve AI

Outlier • Santa Cruz (CA)

Remote
USD 12,000 - 21,000
Remote AI Media Evaluator – Spot AI Flaws
Remote AI Media Evaluator – Spot AI Flaws

Outlier • Charleston (WV)

Remote
USD 17,000 - 24,000
Flexible hours
Fully remote
Free access to leading LLMs
Remote AI Media Evaluator — Spot Flaws & Improve AI
Remote AI Media Evaluator — Spot Flaws & Improve AI

Outlier • Milwaukee (WI)

Hybrid
USD 14,000 - 21,000
Remote AI Media Evaluator — Spot Flaws & Earn
Remote AI Media Evaluator — Spot Flaws & Earn

Outlier • Bozeman (MT)

Remote
USD 17,000 - 21,000
Remote AI Media Evaluator — Spot Flaws & Improve AI
Remote AI Media Evaluator — Spot Flaws & Improve AI

Outlier • Corvallis (OR)

Remote
USD 17,000 - 24,000
Remote work
Flexible hours
Free access to leading LLMs
+2