AI Media Evaluator: Live Prompts, Remote & Flexible

Outlier

Colorado Springs (CO)

Hybrid

USD 15,000 - 25,000

Full time

36 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible hours
Weekly payments
Free access to leading LLMs

Job summary

Outlier invites detail-oriented English speakers to review AI-generated media and rate live conversations with AI voice models. You compare image and video outputs, judge adherence to prompts, and explain issues in writing, all remotely and on your own schedule.

The opportunity helps shape how advanced AI systems reason, learn, and improve, with access to leading LLMs and weekly payouts. Applicants from multiple countries are welcome.

Qualifications

  • Fluent English communication and clear writing required.
  • Strong attention to detail and ability to replay or zoom in on outputs.
  • Comfortable thinking on your feet and talking through scenarios.
  • Experience writing short, evidence-based explanations or reviews.
  • Ability to make clear decisions when both options have flaws.

Responsibilities

  • Holding live, scenario-based conversations with AI voice models and ranking how natural, useful, and clear each one sounded.
  • Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
  • Inspecting outputs closely to spot problems like distorted anatomy, flickering, text errors, or audio-video misalignment.
  • Rating outputs across dimensions and writing a concise English explanation of observations.

Skills

Fluent English communication
Attention to detail
Think on your feet
Evidence-based explanations
Clear decision making

Education

Bachelor's degree or above

Job description

Outlier invites detail-oriented English speakers to review AI-generated media and rate live conversations with AI voice models. You compare image and video outputs, judge adherence to prompts, and explain issues in writing, all remotely and on your own schedule.

The opportunity helps shape how advanced AI systems reason, learn, and improve, with access to leading LLMs and weekly payouts. Applicants from multiple countries are welcome.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Media Evaluator - Remote & Flexible Hours
AI Media Evaluator - Remote & Flexible Hours

Outlier • San Antonio (TX)

Remote
USD 17,000 - 25,000
Weekly payments
Free access to leading LLMs
Flexible scheduling
AI Media Evaluator — English, Remote & Flexible
AI Media Evaluator — English, Remote & Flexible

Outlier • Birmingham (AL)

Remote
USD 17,000 - 25,000
Up to $18 USD/hr
Flexible remote work
Free access to leading LLMs
AI Media Evaluator: Live Prompts & Outputs
AI Media Evaluator: Live Prompts & Outputs

Outlier • Silver Spring (MD)

Hybrid
USD 13,000 - 18,000
Pay up to $18/hr
Flexible remote work from anywhere
Free access to leading LLMs
+1
AI Media Evaluator: Live Evaluations & Comparisons (Remote)
AI Media Evaluator: Live Evaluations & Comparisons (Remote)

Outlier • Amherst (MA)

Remote
USD 20,000 - 29,000
Flexible, remote schedule
Weekly payments
Free access to leading LLMs
+1
AI Media Evaluator — Remote & Flexible
AI Media Evaluator — Remote & Flexible

Outlier • Tuscaloosa (AL)

Remote
USD 20,000 - 29,000
Hourly pay
Flexibility
Free LLM access
+1
AI Media Evaluator: Remote, Flexible Hours, Free LLM Access
AI Media Evaluator: Remote, Flexible Hours, Free LLM Access

Outlier • Tallahassee (FL)

Remote
USD 20,000 - 29,000
Flexible hours
Remote work
Weekly payments (ACH/PayPal/Airtm)
AI Media Evaluator: Remote, Flexible Hours
AI Media Evaluator: Remote, Flexible Hours

Outlier • Cincinnati (OH)

Remote
USD 15,000 - 25,000
Flexible hours
Remote work from anywhere
Free access to leading LLMs
+1
AI Media Evaluator — Live Conversational Rater (English)
AI Media Evaluator — Live Conversational Rater (English)

Outlier • Fayetteville (AR)

Remote
USD 20,000 - 29,000
Weekly payments
Remote work
Free LLM access
+1
AI Media Evaluator — Remote & Flexible
AI Media Evaluator — Remote & Flexible

Outlier • Denver (CO)

Remote
USD 12,000 - 21,000
Weekly payments via ACH, PayPal, AirTM
Free access to leading LLMs
Flexible hours
AI Media Evaluator - Remote, Flexible Hours
AI Media Evaluator - Remote, Flexible Hours

Outlier • Gainesville (FL)

Remote
USD 20,000 - 29,000