Remote AI Quality Evaluator

Outlier

Charlottesville (VA)

Hybrid

USD 12,000 - 21,000

Full time

15 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, judge which images or videos follow prompts best, and explain in writing what looked or sounded off. Earn up to $15/hr with surge incentives and weekly payments.

Contributors can work from home or while traveling, with free access to leading LLMs and ongoing opportunities across multiple projects.

Qualifications

Fluent English with strong written communication.
Excellent attention to detail and patience to replay or zoom in when something seems off.
Bachelor’s degree or higher is nice to have.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatch.
Rating each output across dimensions like adherence, quality, and realism, then writing a concise English explanation of what was observed.