Remote AI Media Evaluator — Spot & Explain Errors

Outlier; Tulsa (OK); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models and score each exchange, comparing generated images and videos to judge which follows the prompt better, and provide written explanations of what looked or sounded off. This is remote and on your schedule.

Experience with clear written communication is essential. Applicants from multiple countries are welcome; compensation is up to $15 USD per hour with

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to analyze and explain results.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and assessing how natural and clear the exchanges sound.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt more closely.
• Inspecting outputs closely to spot issues like distorted visuals or audio-text mismatches; documenting findings in writing.
• Rating outputs across dimensions such as adherence, quality, and realism and providing a concise explanation in English.

Skills

Fluent English

Strong written communication

Attention to detail

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models and score each exchange, comparing generated images and videos to judge which follows the prompt better, and provide written explanations of what looked or sounded off. This is remote and on your schedule.

Experience with clear written communication is essential. Applicants from multiple countries are welcome; compensation is up to $15 USD per hour with