Remote AI Content Evaluator - Live Conversations

Outlier; Tempe (AZ); Remote; USD 17,000 - 28,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free AI tools access

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare generated images and videos to judge prompt accuracy, and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason, learn, and improve. You’ll participate in evaluation loops that translate frontier research into AI that performs better

Qualifications

• Fluent English speaker with strong written communication.
• Great attention to detail and ability to replay or zoom in when something seems off.
• Pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and explaining realistic scenarios.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or mismatched audio.
• Rating outputs across dimensions and writing a concise English explanation of findings.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable speaking spontaneously

Evidence-based writing

Decision making under ambiguity

Education

Bachelor’s degree or above (pursuing welcome)

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, compare generated images and videos to judge prompt accuracy, and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your work helps shape how advanced AI systems reason, learn, and improve. You’ll participate in evaluation loops that translate frontier research into AI that performs better