Remote AI Media Evaluator – Rate & Improve AI Outputs

Outlier; Jacksonville (FL); Hybrid; USD 17,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to LLMs

Weekly payments

Job summary

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image and video outputs, and explain in writing what looked or sounded off, all remotely and on your schedule.

Your work helps shape how advanced AI systems reason and improve, contributing to a broader evaluation loop and better real-world performance.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and patience to review closely.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Able to think on your feet and discuss realistic scenarios naturally.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely and describing issues in writing.
• Rating outputs across dimensions and providing written explanations of findings.

Skills

Fluent English

Attention to detail

Written communication

Explain observations clearly

Decisive when flaws exist

Education

Bachelor's degree or above

Job description

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image and video outputs, and explain in writing what looked or sounded off, all remotely and on your schedule.

Your work helps shape how advanced AI systems reason and improve, contributing to a broader evaluation loop and better real-world performance.