Remote AI Media Evaluator — Spot Flaws & Improve AI

Outlier; Columbia (MD); Hybrid; USD 17,000 - 25,000; Part time

Benefits offered by this job

Weekly payments

Access to leading LLMs

Freelance contract

Job summary

Outlier seeks detail-oriented individuals to review AI-generated media by holding live conversations with AI voice models and evaluating image and video pairs. You will explain in writing what looked or sounded off, remotely and on your own schedule.

Your role helps shape how advanced AI systems reason, learn, and improve as part of Outlier’s evaluation and feedback loop for frontier research applications.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and careful review.
• Bachelor's degree or higher is nice to have.
• Ability to think on your feet and discuss realistic scenarios.

Responsibilities

• Hold live, scenario-based conversations with AI voice models.
• Rank AI outputs for naturalness, usefulness, and clarity.
• Inspect image/video outputs to spot issues like distortions, flickering, or out-of-sync audio.
• Write concise, evidence-based explanations in English citing what was observed.

Skills

Fluent English

Detail oriented

Clear written communication

Conversational thinking

Education

Bachelor's degree or higher

Job description

Outlier seeks detail-oriented individuals to review AI-generated media by holding live conversations with AI voice models and evaluating image and video pairs. You will explain in writing what looked or sounded off, remotely and on your own schedule.

Your role helps shape how advanced AI systems reason, learn, and improve as part of Outlier’s evaluation and feedback loop for frontier research applications.