AI Media Evaluator — Remote, Flexible Hours

Outlier

Norfolk (VA)

Remote

USD 20,000 - 29,000

Full time

13 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Up to $18 USD/hr + incentives

Flexible remote work, no minimum hours

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off.

Work remotely on your own schedule, reviewing images, videos, and captions for prompt adherence and quality. You will log precise explanations in English, focusing on artifacts, motion, audio matching, and realism, contributing to improving AI systems with flexible hours and

Qualifications

Fluent English speaker with clear written communication and comfort with conversational speech.
Strong attention to detail, patience to replay/zoom in and spot issues.
Nice to have: pursuing or holding a Bachelor's degree or above.
Able to think on your feet and discuss realistic scenarios in natural conversation.
Experience writing short, evidence-based explanations or reviews.
Able to decide clearly when both options have flaws.

Responsibilities

Holding live, scenario-based conversations in English with AI voice models, then ranking naturalness and usefulness.
Comparing AI-generated images and videos and judging which follows the prompt better.
Inspecting outputs closely (zooming, replay) to spot issues like distorted anatomy or misalignment.
Rating outputs across dimensions and writing a concise English explanation of findings.