AI Quality Evaluator - Remote & Flexible Hours

Outlier; St. Louis (MO); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Weekly payments

Remote work

Free access to leading LLMs

Flexible schedule

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and compare generated images and videos against prompts, explaining what looked off in writing, all remotely and on your own schedule.

At Outlier, your evaluations help shape how advanced AI systems reason and learn. You’ll contribute to a feedback loop that turns frontier research into AI that performs better in real-world tasks, with

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and patience for thorough review.
• Ability to explain observations clearly in writing.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos to judge adherence to prompts.
• Inspect outputs closely (zoom in, replay) to spot issues like artifacts, flickering, or misalignment.
• Write a concise, evidence-based explanation of findings in English.

Skills

Fluent English

Attention to detail

Clear communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, and compare generated images and videos against prompts, explaining what looked off in writing, all remotely and on your own schedule.

At Outlier, your evaluations help shape how advanced AI systems reason and learn. You’ll contribute to a feedback loop that turns frontier research into AI that performs better in real-world tasks, with