Remote AI Output Evaluator — Flexible Hours

Outlier

Pittsburgh (Allegheny County)

Hybrid

USD 20,000 - 29,000

Full time

14 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible hours
Remote work from anywhere
Free access to leading LLMs
Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely on your own schedule.

You’ll rate outputs, identify issues like visual glitches or audio mismatches, and provide written explanations in clear English. This flexible, remote role lets you work from anywhere with generous incentives and weekly payments.

Qualifications

  • Fluent English speaker with strong, clear written communication.
  • Strong attention to detail and the ability to replay or zoom in when something seems off.
  • Bachelor's degree or higher is nice to have.
  • Comfortable thinking on your feet and discussing realistic scenarios in a natural, conversational way.
  • Experience writing short, evidence-based explanations or reviews.
  • Able to make a clear decision when both options have flaws.
  • Eligible countries include the US, UK, Canada, Ireland, Australia.

Responsibilities

  • Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness and clarity.
  • Compare AI-generated images and videos and judge which better follows the prompt.
  • Inspect outputs carefully to spot problems like distortions, flicker, or audio-visual mismatches.
  • Rate each output across dimensions and write specific explanations in English that point to what you saw or heard.

Skills

Fluent English
Attention to detail
Thinking on your feet
Writing explanations
Decision making under ambiguity

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely on your own schedule.

You’ll rate outputs, identify issues like visual glitches or audio mismatches, and provide written explanations in clear English. This flexible, remote role lets you work from anywhere with generous incentives and weekly payments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Output Evaluator — Flexible Hours
Remote AI Output Evaluator — Flexible Hours

Outlier • Washington

Hybrid
USD 20,000 - 29,000
Flexible hours
Remote work
Weekly payments via ACH, PayPal, AirTM
+1
Remote AI Output Quality Evaluator | Flexible Hours
Remote AI Output Quality Evaluator | Flexible Hours

Outlier • Nashville (TN)

Remote
USD 20,000 - 29,000
Earn Up to $18 USD/hr - Plus extra
Free access to leading LLMs — worth $-
Work flexibly from anywhere, anytime
Remote AI Output Evaluator — Flexible Hours
Remote AI Output Evaluator — Flexible Hours

Outlier • Portland (OR)

Hybrid
USD 17,000 - 25,000
Fully remote
Flexible hours
Weekly payments
Remote AI Video Evaluator — Flexible Hours
Remote AI Video Evaluator — Flexible Hours

Outlier • Phoenix (AZ)

Remote
USD 15,000 - 25,000
Flexible schedule
Remote work
Free LLM access
+1
Remote AI Output Evaluator - Flexible Hours & Pay
Remote AI Output Evaluator - Flexible Hours & Pay

Outlier • Plano (TX)

Hybrid
USD 20,000 - 29,000
Flexible remote work
Free access to leading LLMs
Weekly payments via ACH/PayPal/AirTM
+1
Remote AI Voice Evaluator — Flexible Hours
Remote AI Voice Evaluator — Flexible Hours

Outlier • Boston (MA)

Remote
USD 19,000 - 30,000
Flexible hours
Remote work from anywhere
Weekly payments via ACH/PayPal/AirTM
+1
Remote AI Media Evaluator — Flexible Hours
Remote AI Media Evaluator — Flexible Hours

Outlier • Columbia (SC)

Hybrid
USD 15,000 - 25,000
Flexible hours
Remote work
LLM access
+1
Remote AI Output Evaluator — Flexible Hours
Remote AI Output Evaluator — Flexible Hours

Outlier • West Lafayette (IN)

Hybrid
USD 15,000 - 25,000
Remote work
Flexible hours
Free access to LLMs
+1
Remote AI Output Quality Evaluator — Flexible Hours
Remote AI Output Quality Evaluator — Flexible Hours

Outlier • Philadelphia

Remote
USD 20,000 - 29,000
Weekly payments via ACH/PayPal/AirTM
Remote work from home or travel
Free access to leading LLMs
Remote AI Output Reviewer | Flexible Hours, Competitive Pay
Remote AI Output Reviewer | Flexible Hours, Competitive Pay

Outlier • Columbia Township (MO)

Hybrid
USD 20,000 - 29,000
Earn up to $18 USD/hr
Flexible remote work
Free access to leading LLMs