Remote AI Quality Evaluator — Spot Flaws, Improve Models

Outlier; Raleigh (NC); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Weekly payments

Free access to leading LLMs

Work from anywhere

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay conversations with AI voice models, rank outputs, and explain in writing what looked or sounded off, helping improve AI systems in real-world contexts.

You will work remotely, reviewing images, videos, and audio clips, with payments issued weekly. Prior experience writing concise explanations is a plus, and freedom to set your hours is emphasized.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and ability to replay or zoom in on content.
• Ability to think on your feet and discuss realistic scenarios.
• Experience writing short, evidence-based explanations or reviews.
• Capable of making clear decisions when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows prompts better.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, text/audio mismatches.
• Write specific English explanations pointing to observed issues for each exchange.

Skills

Fluent English

Attention to detail

Fast thinker

Writing explanations

Decision making

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay conversations with AI voice models, rank outputs, and explain in writing what looked or sounded off, helping improve AI systems in real-world contexts.

You will work remotely, reviewing images, videos, and audio clips, with payments issued weekly. Prior experience writing concise explanations is a plus, and freedom to set your hours is emphasized.