AI Output Quality Evaluator — Remote & Flexible

Outlier; Bozeman (MT); Remote; USD 15,000 - 25,000; Part time

Benefits offered by this job

Flexible hours

Free LLM access

Incentives

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare AI-generated images and videos to judge which follows the prompt better, detailing what looked or sounded wrong, all remotely on your schedule.

At Outlier, your evaluations help shape AI reasoning and learning, contributing to frontier research and real-world AI improvements. Free access to leading LLMs is included.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail, able to replay or zoom in.
• Experience writing concise explanations or reviews.
• Bachelor’s degree or higher is a plus.

Responsibilities

• Holding live conversations in English with AI voice models and rating naturalness.
• Comparing AI-generated images and videos to determine which follows prompts better.
• Inspecting outputs closely to spot issues like artifacts or misalignment.
• Writing explanations in English that specify what was off.

Skills

Fluent English

Attention to detail

Clear communication

Decision making

Explanation writing

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare AI-generated images and videos to judge which follows the prompt better, detailing what looked or sounded wrong, all remotely on your schedule.

At Outlier, your evaluations help shape AI reasoning and learning, contributing to frontier research and real-world AI improvements. Free access to leading LLMs is included.