AI Model Evaluator — Remote, Flexible Hours

Outlier

Overland Park (KS)

Remote

USD 15,000 - 25,000

Full time

4 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Up to $18/hr
Flexible hours
Free LLM access
Missions incentives

Job summary

Outlier is seeking detail‑oriented English speakers to review AI‑generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, remotely and on your own schedule.

Work from home with flexible hours and free access to leading LLMs. Earn up to $18/hr plus incentives, reviewing images, videos and audio for prompt adherence, quality and realism, then provide concise explanations.

Qualifications

  • Fluent English with clear written communication.
  • Strong attention to detail and careful listening.
  • Pursuing or holding a Bachelor's degree or above is nice to have.
  • Able to reason aloud and write concise explanations.
  • Capable of deciding when both options have flaws.

Responsibilities

  • Holding a live, scenario-based English conversation with AI voices and ranking naturalness and clarity.
  • Comparing AI-generated images and videos, judging which follows the prompt better.
  • Inspecting outputs with zoom and replay to spot issues like artifacts or misalignment.
  • Writing clear, evidence-based explanations of findings.

Skills

Fluent English
Strong written communication
Attention to detail
Decision making under uncertainty
Ability to provide concise, evidence‑f

Education

Bachelor's degree or above

Job description

Outlier is seeking detail‑oriented English speakers to review AI‑generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, remotely and on your own schedule.

Work from home with flexible hours and free access to leading LLMs. Earn up to $18/hr plus incentives, reviewing images, videos and audio for prompt adherence, quality and realism, then provide concise explanations.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Model Evaluator — Remote & Flexible Hours
AI Model Evaluator — Remote & Flexible Hours

Outlier • Madison (WI)

Remote
USD 20,000 - 29,000
Flexible hours
Remote work from anywhere
Free LLM access
AI Model Evaluator — Remote & Flexible Hours
AI Model Evaluator — Remote & Flexible Hours

Outlier • Charlottesville (VA)

Remote
USD 20,000 - 29,000
Flexible hours
Remote from anywhere
Free access to leading LLMs
+1
AI Model Evaluator — Remote & Flexible Hours
AI Model Evaluator — Remote & Flexible Hours

Outlier • Portland (OR)

Remote
USD 20,000 - 29,000
Flexible hours
Remote work from anywhere
Free access to leading LLMs
AI Model Evaluator — Remote, Flexible Hours, Free LLM Access
AI Model Evaluator — Remote, Flexible Hours, Free LLM Access

Outlier • Tacoma (WA)

Remote
USD 20,000 - 29,000
Hourly pay up to $18
Flexible hours
Free access to LLMs
+1
AI Model Evaluator: Remote, Flexible Hours
AI Model Evaluator: Remote, Flexible Hours

Outlier • Columbia Township (MO)

Remote
USD 20,000 - 29,000
Up to $18/hr
Flexible hours
Free access to LLMs
+1
AI Media Evaluator — Remote, Flexible Hours
AI Media Evaluator — Remote, Flexible Hours

Outlier • Columbia Township (MO)

Hybrid
USD 20,000 - 29,000
Free access to leading LLMs
Weekly payments via ACH, PayPal and E2
Flexible hours
AI Media Evaluator — Remote & Flexible Hours
AI Media Evaluator — Remote & Flexible Hours

Outlier • Albuquerque (NM)

Remote
USD 12,000 - 21,000
Free access to leading LLMs
Flexible hours
AI Media Evaluator — Remote, Flexible Hours
AI Media Evaluator — Remote, Flexible Hours

Outlier • Billings (MT)

Remote
USD 20,000 - 29,000
Earn up to $18/hr
Flexible schedule
Free LLM access
+1
AI Model Quality Evaluator — Remote & Flexible Pay
AI Model Quality Evaluator — Remote & Flexible Pay

Outlier • Jacksonville (FL)

Remote
USD 15,000 - 25,000
Flexible hours
Fully remote work
Weekly payments via ACH/PayPal/AirTM
+1
AI Model Evaluator — Remote & Flexible Hours
AI Model Evaluator — Remote & Flexible Hours

Outlier • Amherst (MA)

Remote
USD 17,000 - 25,000
Weekly payments
Free access to leading LLMs
Flexible hours
+1