Remote AI Evaluator — Spot Issues & Rate Outputs

Outlier; Milwaukee (WI); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home with flexible hours. You will hold live conversations with AI voice models, score exchanges, compare AI-created images and videos, and explain what looked or sounded off in writing—all remotely and on your own schedule.

Your work helps shape how advanced AI systems reason and learn, supporting frontier research to improve AI performance in real-world use.

Qualifications

• Fluent English with strong written communication.
• Experience writing short explanations/reviews.

Responsibilities

• Holding live, scenario-based conversations with AI voice models
• Ranking naturalness and usefulness of exchanges
• Comparing AI-generated images/videos and judging prompt adherence
• Writing explanations in English pointing to observed issues

Skills

Fluent English

Attention to detail

Clear written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home with flexible hours. You will hold live conversations with AI voice models, score exchanges, compare AI-created images and videos, and explain what looked or sounded off in writing—all remotely and on your own schedule.

Your work helps shape how advanced AI systems reason and learn, supporting frontier research to improve AI performance in real-world use.