Remote AI Media Evaluator: Voice, Image & Video QA

Outlier; Durham (NC); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Up to $18/hr

Flexible hours

Free LLM access

Missions surge pricing incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from anywhere in the world. You will roleplay live conversations with an AI voice model and score each exchange, then explain in writing what looked or sounded off.

As part of Outlier’s evaluation loop, your work helps improve AI systems by comparing generated images, videos, and captions to the prompts and providing precise feedback. You can work remotely on your own schedule with weekly payments.

Qualifications

• Fluent English with strong written communication.
• Detail orientation and patience to inspect closely.
• Able to articulate observations in writing.
• Comfortable thinking on your feet in live conversations.

Responsibilities

• Hold live conversations with AI voice models in English and rate how natural and clear each one sounds.
• Compare pairs of AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs for issues like artifacts, distortion, or audio-video mismatches.
• Rate outputs on adherence, quality, and realism, with a written explanation of findings.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable with real-time dialogue

Ability to explain observations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from anywhere in the world. You will roleplay live conversations with an AI voice model and score each exchange, then explain in writing what looked or sounded off.

As part of Outlier’s evaluation loop, your work helps improve AI systems by comparing generated images, videos, and captions to the prompts and providing precise feedback. You can work remotely on your own schedule with weekly payments.