AI Media Quality Evaluator — Remote & Flexible

Outlier; Lawrence (KS); Hybrid; USD 15,000 - 25,000; Full time

Benefits offered by this job

Up to $18/hr

Free access to leading LLMs

Flexible scheduling

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media, including live conversations with AI voice models and comparisons of images and videos to judge prompt adherence. You will explain what looked or sounded off, remotely and on your own schedule, helping shape how advanced AI systems reason and improve.

Responsibilities include scoring outputs, providing written explanations, and working from home with flexible hours.

Qualifications

• Fluent English with clear written communication.
• Great attention to detail and patience to replay or zoom in.
• Experience writing concise evidence-based explanations or reviews.
• Comfortable making clear decisions when multiple flaws exist.

Responsibilities

• Holding live conversations in English with AI voice models and rating naturalness and usefulness.
• Comparing AI-generated images and videos to judge adherence to prompts.
• Inspecting outputs closely to spot issues like distortion or misalignment and explaining findings in writing.
• Rating outputs on dimensions like adherence, quality, and realism and providing written justifications.

Skills

Fluent English

Attention to detail

Strong written communication

AI evaluation experience

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media, including live conversations with AI voice models and comparisons of images and videos to judge prompt adherence. You will explain what looked or sounded off, remotely and on your own schedule, helping shape how advanced AI systems reason and improve.

Responsibilities include scoring outputs, providing written explanations, and working from home with flexible hours.