AI Media Evaluator — Live Conversations & Visual QA

Outlier; Fort Wayne (IN); Remote; USD 15,000 - 25,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges. You will compare AI-generated images and videos to determine which better follows prompts and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your evaluation helps shape how advanced AI systems reason, learn, and improve. Workers are paid weekly, with flexible hours and access to leading LLMs.

Qualifications

• Fluent English with strong written communication.
• Keen attention to detail and ability to replay or zoom in on outputs.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos; judge which follows the prompt better.
• Inspect outputs closely to spot issues like distortions, flickers, unclear audio, or misalignment, then document findings in English.

Skills

Fluent English

Attention to detail

Clear written communication

Excellent in real-time reasoning

Bachelor's degree (nice to have)

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges. You will compare AI-generated images and videos to determine which better follows prompts and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your evaluation helps shape how advanced AI systems reason, learn, and improve. Workers are paid weekly, with flexible hours and access to leading LLMs.