AI Media Quality Evaluator — Remote & Flexible

Outlier; Lawrence (KS); Remote; USD 17,000 - 28,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of a remote setup. You will roleplay live conversations with AI voice models, score exchanges, and compare generated media to determine which better follows prompts.

You will explain in writing what looked or sounded off, contributing to improvements in frontier AI systems. The role is remote with flexible hours and pay varies by expertise and project requirements.

Qualifications

• Fluent English with strong, clear written communication.
• Patience to look and listen closely and replay or zoom in.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable deciding clearly when options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing AI-generated image and video pairs and judging which follows the prompt better.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or mismatched audio.
• Rating outputs across dimensions like adherence, quality, and realism and writing a concise English explanation.

Skills

Fluent English

Detail-oriented

Clear written communication

Written explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of a remote setup. You will roleplay live conversations with AI voice models, score exchanges, and compare generated media to determine which better follows prompts.

You will explain in writing what looked or sounded off, contributing to improvements in frontier AI systems. The role is remote with flexible hours and pay varies by expertise and project requirements.