Remote AI Media Evaluator - Spot Flaws & Rate Outputs

Outlier

Indianapolis (IN)

Remote

USD 20,000 - 29,000

Full time

22 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Earn up to $18 USD/hr
Flexible remote work
Free access to leading LLMs
Missions surge pricing bonus

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely with flexible hours. You will roleplay live conversations with AI voice models, score exchanges, compare generated images and videos to judge which follows the prompt better, and explain in writing what looked or sounded wrong, all on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason, learn, and improve, contributing to frontier research and real-world performance.

Qualifications

  • Fluent English with clear written communication.
  • Strong attention to detail and ability to replay or zoom to inspect.
  • Bachelor's degree or above is a plus.
  • Comfortable thinking on your feet in natural conversations.
  • Experience writing concise, evidence-based reviews.
  • Able to decide when both options have flaws.

Responsibilities

  • Holding live conversations with AI voice models and rank naturalness and usefulness.
  • Comparing AI-generated images and videos for prompt adherence.
  • Inspect outputs to spot problems like distortion, flicker, or misalignment.
  • Write explanations in English detailing what was observed.

Skills

Fluent English
Attention to detail
Adaptable in live conversations
Experience writing explanations
Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely with flexible hours. You will roleplay live conversations with AI voice models, score exchanges, compare generated images and videos to judge which follows the prompt better, and explain in writing what looked or sounded wrong, all on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason, learn, and improve, contributing to frontier research and real-world performance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Media Evaluator: Spot Flaws & Rank Outputs
Remote AI Media Evaluator: Spot Flaws & Rank Outputs

Outlier • Manchester (NH)

Remote
USD 20,000 - 29,000
Up to $18 USD/hr
Flexible remote work
Free access to leading LLMs
Remote AI Media Evaluator: Spot Flaws & Judge Prompts
Remote AI Media Evaluator: Spot Flaws & Judge Prompts

Outlier • West Lafayette (IN)

Remote
USD 17,000 - 25,000
Up to $18/hr
Flexible schedule
LLM access
+1
Remote AI Media Evaluator — Spot Flaws & Explain
Remote AI Media Evaluator — Spot Flaws & Explain

Outlier • Wichita (KS)

Hybrid
USD 20,000 - 29,000
Free access to leading LLMs
Weekly payments via ACH, PayPal andAir
Flexible hours
Remote AI Media Evaluator — Spot Flaws & Explain
Remote AI Media Evaluator — Spot Flaws & Explain

Outlier • Bloomington (IN)

Remote
USD 15,000 - 25,000
Flexible hours
Remote work
Free access to leading LLMs
Remote AI Media Evaluator: Spot Flaws & Improve Models
Remote AI Media Evaluator: Spot Flaws & Improve Models

Outlier • Atlanta (GA)

Remote
USD 20,000 - 29,000
Hourly pay up to $18
Flexible hours, work from anywhere
Free access to leading LLMs
+1
Remote AI Media Evaluator — Spot Flaws & Improve Models
Remote AI Media Evaluator — Spot Flaws & Improve Models

Outlier • Reno (NV)

Remote
USD 19,000 - 30,000
Up to $18 USD/hr
Flexible hours
Free access to leading LLMs
Remote AI Media Evaluator — Spot Flaws & Give Insights
Remote AI Media Evaluator — Spot Flaws & Give Insights

Outlier • Des Moines (IA)

Remote
USD 20,000 - 29,000
Flexible work from home
Free access to leading LLMs
Weekly payments
Remote AI Media Evaluator: Spot Flaws & Explain
Remote AI Media Evaluator: Spot Flaws & Explain

Outlier • Florida

Remote
USD 20,000 - 29,000
Flexible hours
Remote work from anywhere
Free access to leading LLMs
+1
Remote AI Media Evaluator: Spot Flaws & Compare Outputs
Remote AI Media Evaluator: Spot Flaws & Compare Outputs

Outlier • Fargo (ND)

Remote
USD 15,000 - 25,000
Remote AI Media Evaluator - Spot Flaws & Improve Outputs
Remote AI Media Evaluator - Spot Flaws & Improve Outputs

Outlier • Frisco (TX)

Remote
USD 20,000 - 29,000
Hourly pay up to $18
Flexible, remote work
Free access to leading LLMs
+1