AI Media Evaluator — Remote, Flexible Hours, LLM Access

Outlier; Louisville (KY); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours; remote from anywhere

Free access to leading LLMs

Job summary

Outlier is hiring detail-oriented reviewers to evaluate AI-generated media. You will engage in live, scenario-based conversations with AI voice models, compare image and video outputs, and explain what looks off, all remotely and on your own schedule.

Ideal candidates are fluent in English, highly attentive to detail, and capable of writing concise, evidence-based explanations. Remote work is offered with flexible hours, and participants can access leading LLMs for free.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to review outputs.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making clear decisions when options have flaws.

Responsibilities

• Holding live, scenario-based conversations with AI voice models, then ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging which follows the prompt more accurately.
• Inspecting outputs closely (zooming in, replaying) to spot issues like distorted anatomy, flickering, or misaligned audio.
• Rating each output across dimensions and writing a concise English explanation of what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Education

Bachelor’s degree or higher

Job description

Outlier is hiring detail-oriented reviewers to evaluate AI-generated media. You will engage in live, scenario-based conversations with AI voice models, compare image and video outputs, and explain what looks off, all remotely and on your own schedule.

Ideal candidates are fluent in English, highly attentive to detail, and capable of writing concise, evidence-based explanations. Remote work is offered with flexible hours, and participants can access leading LLMs for free.