Remote AI Evaluator & Quality Reviewer

Outlier

Albuquerque (NM)

Remote

USD 17,000 - 24,000

Full time

14 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote-friendly

Flexible hours

Weekly payments

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will hold live conversations with AI voice models, compare image and video pairs, and explain in writing what looked off, helping improve AI reasoning and performance.

Responsibilities include ranking naturalness, quality, and alignment to prompts, plus providing concise, evidence-based explanations.

Qualifications

Fluent English speaker with strong, clear written communication.
Excellent attention to detail and patience to look and listen closely.
Experience writing short, evidence-based explanations or reviews.
Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
Comparing pairs of AI-generated images and videos and judging which follows the prompt more closely.
Inspecting outputs closely (zooming/replaying) to spot problems like distorted anatomy or audio-video mismatches.
Rating outputs across dimensions and writing concise explanations in English detailing what was observed.