AI Media Evaluator — Remote & Flexible Hours

Outlier; Henderson (NV); Hybrid; USD 20,000 - 29,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments via ACH/PayPal/AirTM

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, score exchanges, and compare generated images and videos to judge which follows the prompt better, explaining in writing what looked or sounded off, all remotely and on your schedule.

At Outlier, your work helps shape how AI systems reason and learn. You’ll contribute to improving AI performance via evaluation and feedback loops, enabling frontier research

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail.
• Ability to write concise, evidence-based explanations.
• Comfortable discussing realistic scenarios aloud.
• Experience evaluating AI-generated media is a plus.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models.
• Rank AI-generated images and videos by fidelity to prompts.
• Inspect outputs closely to spot problems like artifacts or mismatches.
• Write explanations in English detailing what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based reviews

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, score exchanges, and compare generated images and videos to judge which follows the prompt better, explaining in writing what looked or sounded off, all remotely and on your schedule.

At Outlier, your work helps shape how AI systems reason and learn. You’ll contribute to improving AI performance via evaluation and feedback loops, enabling frontier research