Remote AI Media Evaluator — Flexible Hours

Outlier; Ames (IA); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Remote work from anywhere

Free access to leading LLMs

Additional incentives via Missions

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, score exchanges, and explain what looked or sounded off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how AI systems reason, learn, and improve by providing evaluation feedback that supports frontier research becoming real-world AI improvements.

Qualifications

• Fluent English and clear written communication required.
• Detail oriented with the ability to explain issues in writing.
• Experience writing short explanations or reviews.
• Bachelor’s degree or above preferred.

Responsibilities

• Hold a live, scenario-based conversation in English with AI voice models, then rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which one better follows the prompt.
• Inspect outputs closely—zoom in and replay—to spot problems like distorted anatomy, flickering or mismatched audio.
• Write a concise, evidence-based explanation in English pointing to what you saw or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, score exchanges, and explain what looked or sounded off, all remotely and on your own schedule.

At Outlier, your expertise helps shape how AI systems reason, learn, and improve by providing evaluation feedback that supports frontier research becoming real-world AI improvements.