Remote AI Quality Evaluator — English

Outlier; Santa Fe (NM); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible remote work

Weekly payments via ACH/PayPal/AirTM

Job summary

Outlier is offering a fully remote, flexible opportunity to review AI-generated media. You will conduct live conversations with AI voices, compare image and video pairs, and explain what’s off.

This role turns frontier AI research into practical improvements, with payments weekly and up to $15 per hour. Ideal candidates are fluent English speakers with keen attention to detail and strong written communication.

Qualifications

• Fluent English with strong, clear written communication.
• Excellent attention to detail and ability to replay or zoom in to spot issues.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to think on your feet and explain decisions clearly in realistic scenarios.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models.
• Ranking naturalness and usefulness of each interaction.
• Comparing AI-generated images and videos to judge adherence to prompts.
• Inspecting outputs to spot issues like distorted anatomy, flickering, or mismatched audio.
• Rating outputs across dimensions and writing detailed English explanations.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under ambiguity

Education

Bachelor’s degree or above

Job description

Outlier is offering a fully remote, flexible opportunity to review AI-generated media. You will conduct live conversations with AI voices, compare image and video pairs, and explain what’s off.

This role turns frontier AI research into practical improvements, with payments weekly and up to $15 per hour. Ideal candidates are fluent English speakers with keen attention to detail and strong written communication.