Remote English AI Evaluator & Reviewer

Outlier; Denver (CO); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible hours, remote work

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off, from home or while traveling.

We offer access to leading LLMs, weekly payments, and the opportunity to contribute to frontier AI research by providing structured feedback that helps improve real-world performance.

Qualifications

• Fluent English speaker with clear written communication and natural conversational speech.
• Strong attention to detail; able to replay or zoom in to spot issues.
• Nice to have a Bachelor's degree or above.
• Able to think on your feet and discuss realistic scenarios conversationally.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Hold a live, scenario-based conversation in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely: zoom in or replay to spot issues like distorted anatomy, flickering, or mismatched audio.
• Rate outputs across dimensions like adherence, quality, and realism, and write a specific English explanation detailing observations.

Skills

Fluent English

Attention to detail

Clear communication

Bachelor's degree or above

Explain reasoning

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain in writing what looked or sounded off, from home or while traveling.

We offer access to leading LLMs, weekly payments, and the opportunity to contribute to frontier AI research by providing structured feedback that helps improve real-world performance.