Remote AI Media Evaluator: Spot Flaws & Rate AI Outputs

Outlier; Fort Worth (TX); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home. You will roleplay live conversations with AI voice models, compare image and video pairs, and explain what’s off in writing, remotely and on your own schedule.

You’ll help shape AI systems by providing structured feedback, scoring outputs across adherence, quality, and realism, and producing specific English explanations for improvements.

Qualifications

• Fluent English with clear written communication

Responsibilities

• Hold live conversations with AI voice models and rank how natural, useful, and clear each one sounded.
• Compare AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely, zoom in or replay to spot problems like distortions, flickering, or mismatched audio.
• Write a concise explanation in English detailing what was observed and why it mattered.

Skills

Fluent English

Attention to detail

Written explanations

Decision making under imperfectoptions

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home. You will roleplay live conversations with AI voice models, compare image and video pairs, and explain what’s off in writing, remotely and on your own schedule.

You’ll help shape AI systems by providing structured feedback, scoring outputs across adherence, quality, and realism, and producing specific English explanations for improvements.