AI Media Evaluator — Remote & Flexible Hours

Outlier; Saint Paul (MN); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Weekly payments

Free access to leading LLMs

Remote work from anywhere

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, remote schedule. You will participate in live conversations with AI voice models, compare AI-generated images and videos, and provide written explanations of what looked or sounded off.

Your work helps improve AI reasoning and performance, with payments weekly and access to leading LLMs. Apply if you can think clearly under varying prompts.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and the patience to replay or zoom in when needed.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Able to think on your feet and discuss realistic situations naturally.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking how natural, useful, and clear each sounded.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely (zooming in, replaying) to spot problems like distortions, artifacts, or misaligned audio.
• Rating each output across dimensions (adherence, quality, realism) and writing an English explanation describing what was observed.

Skills

Fluent English

Attention to detail

Written communication

Decision making

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, remote schedule. You will participate in live conversations with AI voice models, compare AI-generated images and videos, and provide written explanations of what looked or sounded off.

Your work helps improve AI reasoning and performance, with payments weekly and access to leading LLMs. Apply if you can think clearly under varying prompts.