AI Media Evaluator — Remote, Flexible Hours

Outlier; Omaha (NE); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible schedule

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with AI voice models, compare image and video outputs for prompt fidelity, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

As part of Outlier’s evaluation loop, you will help steer AI systems toward better reasoning and real-world performance. The role offers flexible hours, no minimum commitments, weekly payments, and free access to leading

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and patience to replay or zoom in when something seems off.
• Experience writing concise, evidence-based explanations or reviews.
• Comfortable working remotely with flexible scheduling.
• Bachelor’s degree or higher is preferred.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness, usefulness and clarity.
• Comparing AI-generated images and videos to assess adherence to prompts.
• Inspecting outputs closely to spot problems like artifacts, motion issues, or misaligned audio, using zoom or replay as needed.
• Rating outputs on dimensions such as adherence, quality, and realism, and writing explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Adaptable / self-motivated

Evaluation experience

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with AI voice models, compare image and video outputs for prompt fidelity, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

As part of Outlier’s evaluation loop, you will help steer AI systems toward better reasoning and real-world performance. The role offers flexible hours, no minimum commitments, weekly payments, and free access to leading