Remote English AI Reviewer: Spot Flaws & Rate Prompts

Outlier; Blacksburg (VA); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Job summary

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare images and videos to assess adherence to prompts.

You will write specific, evidence-based explanations of what looked or sounded off, all remotely and on your own schedule. You will help shape how advanced AI systems reason and learn by providing evaluation feedback.

Qualifications

• Fluent English speaker with strong written communication.
• Excellent attention to detail and patience to replay or zoom in when something seems off.
• Nice to have: Pursuing or holding a Bachelor's degree or above.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos, judging which better follows the prompt.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, or misaligned audio, then explain findings in writing.
• Rate outputs across dimensions and provide a concise English explanation of the observed issues.

Skills

English fluency

Attention to detail

Clear written communication

Decision-making under ambiguity

Education

Bachelor's degree or higher

Job description

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare images and videos to assess adherence to prompts.

You will write specific, evidence-based explanations of what looked or sounded off, all remotely and on your own schedule. You will help shape how advanced AI systems reason and learn by providing evaluation feedback.