AI Media Evaluator — Remote & Flexible Hours

Outlier; Missoula (MT); Hybrid; USD 20,000 - 29,000; Part time

Benefits offered by this job

Free LLM access

Weekly payments

Flexible hours

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, remote basis. You will roleplay live conversations with AI voice models, rate outputs, and explain what looked off, all in writing.

Responsibilities include comparing image and video pairs, identifying issues like distorted anatomy or misaligned audio, and delivering clear explanations to help improve AI systems.

Qualifications

• Fluent English with strong written communication and comfort with conversational speech.
• Strong attention to detail and patience to replay or zoom in when needed.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.
• Open to applicants from multiple countries (US, UK, Canada, Australia, Ireland).

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio mismatch.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard.

Skills

Fluent English

Attention to detail

Clear writing

Evidence-based explanations

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, remote basis. You will roleplay live conversations with AI voice models, rate outputs, and explain what looked off, all in writing.

Responsibilities include comparing image and video pairs, identifying issues like distorted anatomy or misaligned audio, and delivering clear explanations to help improve AI systems.