Remote AI Model Evaluator — Flexible Hours, Weekly Pay

Outlier; Des Moines (IA); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible remote work

Free access to leading LLMs

Weekly payments via ACH/PayPal/AirTM

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare generated images and videos to judge which follows prompts more accurately.

You will describe in writing what looked or sounded off, all remotely and on your own schedule. This role helps shape how AI systems reason and learn in real-world use.

Qualifications

• Fluent English speaker with strong written communication.
• Excellent attention to detail and ability to replay or zoom in to spot issues.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable speaking and writing about realistic scenarios in a natural, conversational way.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos to assess adherence to prompts and quality.
• Inspecting outputs to spot problems like distorted anatomy, flickering, or mismatched audio.
• Writing a clear, English explanation pointing to observed issues.

Skills

Fluent English

Clear written communication

Attention to detail

Ability to rate and explain

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare generated images and videos to judge which follows prompts more accurately.

You will describe in writing what looked or sounded off, all remotely and on your own schedule. This role helps shape how AI systems reason and learn in real-world use.