AI Media Evaluator — Remote, Flexible Hours

Outlier; Saint Paul (MN); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free LLM access

Incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what looked off, all remotely and on your own schedule.

As part of Outlier’s evaluation loop, you help shape how advanced AI systems reason and learn by providing written explanations and scores across accuracy, realism, and alignment. This is a remote, flexible-hour opportunity with competitive pay.

Qualifications

• Fluent English with clear written communication.
• Detail-oriented with patience to replay or zoom in.
• Experience writing concise explanations or reviews.
• Comfortable discussing realistic scenarios in conversation.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge prompt adherence.
• Inspect outputs to spot issues like distorted anatomy, flickering, or misaligned audio.
• Write a concise English explanation of findings, pointing to observations.

Skills

Fluent English

Clear written communication

Attention to detail

Explain insights in writing

Conversation in real-time

Bachelor's degree or higher

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with AI voice models, compare image and video pairs, and explain what looked off, all remotely and on your own schedule.

As part of Outlier’s evaluation loop, you help shape how advanced AI systems reason and learn by providing written explanations and scores across accuracy, realism, and alignment. This is a remote, flexible-hour opportunity with competitive pay.