Remote AI Media Evaluator — Live Conversation Scorer

Outlier; Winston-Salem (NC); Hybrid; USD 17,000 - 25,000; Full time

Benefits offered by this job

Earn up to $18/hr

Free access to leading LLMs

Flexible scheduling

Job summary

Outlier seeks detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, rank outputs for naturalness and usefulness, and compare image/video pairs to judge prompt fidelity.

You will write concise, evidence-based explanations in English highlighting what looked or sounded off, contributing to improving AI behavior from your home on a flexible schedule.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and careful review of outputs.
• Experience writing concise, evidence-based explanations.

Responsibilities

• Hold live conversations in English with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images and videos and judge how well they follow prompts.
• Inspect outputs closely, including zooming and replaying, to spot issues like artifacts or misalignment.
• Rate outputs across dimensions and write a concise English explanation of observations.

Skills

Fluent English

Attention to detail

Clear written communication

Explain findings clearly

Decision-making under ambiguity

Education

Bachelor's degree or higher

Job description

Outlier seeks detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, rank outputs for naturalness and usefulness, and compare image/video pairs to judge prompt fidelity.

You will write concise, evidence-based explanations in English highlighting what looked or sounded off, contributing to improving AI behavior from your home on a flexible schedule.