AI Media Evaluator (English) — Remote & Flexible

Outlier; New Orleans (LA); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Free access to leading LLMs

Weekly payments

Job summary

Outlier is hiring remote evaluators to review AI-generated media. You will engage in live conversations with AI voice models, compare and rank outputs, and describe in writing what looked or sounded wrong. The role supports flexible hours and is fully remote.

Contributors review images, videos and captions, ensuring alignment with prompts, and provide concise, evidence-based explanations. Pays weekly, with additional incentives and access to leading LLMs.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Great attention to detail and ability to replay or zoom in to verify outputs.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to make clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking naturalness, usefulness and clarity.
• Comparing pairs of AI-generated images and videos and judging which follows prompts better.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or misaligned audio.
• Rating each output across dimensions and writing a focused English explanation of findings.

Skills

Fluent English

Written communication

Attention to detail

Decision making

Education

Bachelor's degree or above

Job description

Outlier is hiring remote evaluators to review AI-generated media. You will engage in live conversations with AI voice models, compare and rank outputs, and describe in writing what looked or sounded wrong. The role supports flexible hours and is fully remote.

Contributors review images, videos and captions, ensuring alignment with prompts, and provide concise, evidence-based explanations. Pays weekly, with additional incentives and access to leading LLMs.