Remote AI Quality Evaluator

Outlier

Tuscaloosa (AL)

Remote

USD 15,000 - 25,000

Full time

5 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Pay up to $18/hr

Flexible hours

Remote work

Free LLM access

Bonus incentives

Job summary

Outlier invites detail-oriented individuals to review AI-generated media on a flexible remote schedule. You will participate in live conversations with AI voice models, compare AI-produced images and videos, and assess how well prompts are followed, explaining your observations in writing.

Role focuses on judging realism, quality, and adherence across media types, with compensation up to $18 per hour and ongoing access to advanced language models. Remote work enables travel or home offices.

Qualifications

Fluent English with clear written communication.
Detail-oriented with patience to replay or zoom in.
Nice to have: pursuing or holding a Bachelor's degree or above.
Comfortable thinking on your feet and discussing realistic scenarios.
Experience writing short, evidence-based explanations.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio that doesn't match the video.
Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard.