Remote AI Quality Evaluator (English) – Flexible Hours

Outlier; Arlington (VA); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Remote work

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of your home. You will conduct live conversations with AI voice models, compare images and videos, and explain in writing what looked or sounded off, all on a flexible schedule.

You will help shape how advanced AI systems reason and learn, contributing to frontier research and practical improvements. This is a freelance, remote role with pay per hour and occasional incentives.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and the ability to replay or zoom in while assessing content.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and discussing realistic situations in a natural way.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models.
• Ranking how natural, useful, and clear each AI voice sounded.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely (zooming in and replaying) to spot issues like distorted anatomy or audio-visual mismatches.
• Rating outputs across dimensions like adherence, quality, and realism and writing explanations in English.

Skills

Fluent English

Attention to detail

Written explanations

Decision making

Verbal communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of your home. You will conduct live conversations with AI voice models, compare images and videos, and explain in writing what looked or sounded off, all on a flexible schedule.

You will help shape how advanced AI systems reason and learn, contributing to frontier research and practical improvements. This is a freelance, remote role with pay per hour and occasional incentives.