Remote AI Media Evaluator & Reviewer

Outlier; Scottsdale (AZ); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Remote work

Job summary

Outlier seeks detail-oriented English-speaking reviewers to evaluate AI-generated media. You will conduct live conversations with AI voice models, compare outputs, and explain what’s off in clear, written terms.

This remote, flexible role helps shape AI systems by providing precise feedback on realism and prompt adherence. Responsibilities include ranking naturalness of conversations, evaluating image/video pairs, and writing concise explanations.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to explain findings clearly.
• Ability to think and explain examples in written form.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and rating naturalness and usefulness.
• Comparing AI-generated image/video pairs and judging which follows the prompt better.
• Inspecting outputs to spot issues like distorted anatomy, flickering, or misaligned audio.
• Writing a concise English explanation of your observations and decisions.

Skills

Fluent English

Attention to detail

Clear written communication

Job description

Outlier seeks detail-oriented English-speaking reviewers to evaluate AI-generated media. You will conduct live conversations with AI voice models, compare outputs, and explain what’s off in clear, written terms.

This remote, flexible role helps shape AI systems by providing precise feedback on realism and prompt adherence. Responsibilities include ranking naturalness of conversations, evaluating image/video pairs, and writing concise explanations.