Remote AI Media Quality Evaluator — Flexible Hours

Outlier; Laredo (TX); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with an AI voice model, score exchanges, compare AI-generated images and videos to prompts, and explain what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your work helps shape how AI systems reason and improve. You’ll use live prompts and review loops to contribute to frontier research and real-world AI performance.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and careful listening.
• Bachelor's degree or above preferred.
• Comfortable thinking on your feet and talking through realistic situations.
• Experience writing short, evidence-based explanations or reviews.
• Able to decide clearly when both options have flaws.

Responsibilities

• Holding live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering, or audio mismatches.
• Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English that points to what you saw or heard.

Skills

Fluent English

Attention to detail

Clear writing

Decision making

Evidence-based reviews

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with an AI voice model, score exchanges, compare AI-generated images and videos to prompts, and explain what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your work helps shape how AI systems reason and improve. You’ll use live prompts and review loops to contribute to frontier research and real-world AI performance.