Remote AI Evaluator: Spot AI Errors & Improve Models

Outlier

San Luis Obispo (CA)

Remote

USD 17,000 - 24,000

Full time

11 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Earn up to $15 USD/hr

Flexible hours

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will conduct live conversations with an AI voice model, compare AI-generated images and videos, and explain in writing what looked off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve. This is a remote, freelance opportunity with weekly payments and flexible hours; you’ll have free access to leading LLMs and participate in

Qualifications

Fluent English speaker with clear written communication.
Strong attention to detail and ability to replay or zoom in when something seems off.
Experience writing short, evidence-based explanations or reviews.
Comfortable making a clear decision when both options have flaws.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
Comparing pairs of AI-generated images and videos and judging which follows the prompt more closely.
Inspecting outputs closely (zooming in, replaying) to spot problems like distorted anatomy, flickering, or text/audio mismatch.
Rating outputs across dimensions and writing a concise English explanation of observations.