Remote AI Quality Evaluator — Detail-Focused Reviewer

Outlier; Fort Wayne (IN); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible work from anywhere

Remote work with flexible hours

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what’s off in writing.

Review and compare AI-generated images and videos to judge adherence to prompts, providing precise feedback from home on a flexible schedule. Join Outlier’s evaluation loop to help improve AI systems that reason and learn, with access to leading LLMs and potential additional incentives based on missions

Qualifications

• Fluent English speaker with strong written communication.
• Excellent attention to detail and ability to replay or zoom in to verify outputs.
• Nice to have: pursuing or holding a bachelor’s degree or above.
• Comfortable thinking on your feet and describing realistic scenarios in natural conversation.

Responsibilities

• Hold live conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos, judge adherence to prompts and visual quality.
• Inspect outputs closely (zoom/replay) to spot distortions, motion issues, text errors, or audio-video misalignment.
• Provide a written, evidence-based explanation of findings in English.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable with conversational speech

Bachelor's degree (nice to have)

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what’s off in writing.

Review and compare AI-generated images and videos to judge adherence to prompts, providing precise feedback from home on a flexible schedule. Join Outlier’s evaluation loop to help improve AI systems that reason and learn, with access to leading LLMs and potential additional incentives based on missions