AI Media Evaluator — Remote & Flexible Hours

Outlier; Eugene (OR); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible work from anywhere

Free access to leading LLMs

Potential incentives and surge pricing

Job summary

Outlier is seeking detail-oriented reviewers to rate AI-generated media via live conversations with AI voice models. You will compare image and video outputs to prompts, explain identified issues in writing, and work remotely on your own schedule.

Ideal candidates are fluent in English, highly attentive, and can produce concise, evidence-based explanations. Bachelor’s degree or higher is preferred, with the ability to decide clearly when faced with imperfect options.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail, able to replay or zoom in when something seems off.
• Bachelor's degree or higher preferred.
• Comfortable thinking on your feet and discussing realistic scenarios naturally.
• Experience writing short, evidence-based explanations or reviews.
• Ability to make clear decisions when options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs to spot issues like distorted anatomy, flickering, or mismatched audio and video.
• Provide written explanations highlighting what was observed and why decisions were made.

Skills

Fluent English

Attention to detail

Written communication

Decision making

Evidence-based explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented reviewers to rate AI-generated media via live conversations with AI voice models. You will compare image and video outputs to prompts, explain identified issues in writing, and work remotely on your own schedule.

Ideal candidates are fluent in English, highly attentive, and can produce concise, evidence-based explanations. Bachelor’s degree or higher is preferred, with the ability to decide clearly when faced with imperfect options.