AI Quality Assessor — Remote & Flexible Hours

Outlier; Bellevue (WA); Hybrid; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments

Free LLM access

Job summary

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all remotely and on your own schedule.

You will help shape how advanced AI systems reason, learn, and improve through evaluation and feedback. Join Outlier to contribute to AI that performs better in real-world scenarios, with flexible hours and the benefit of free access to leading LLMs.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and the ability to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable thinking on your feet and explaining decisions clearly.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or audio-video mismatches.
• Rating outputs on adherence, quality and realism, then writing an English explanation of what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable with realistic scenarios

Education

Bachelor's degree (nice to have)

Job description

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all remotely and on your own schedule.

You will help shape how advanced AI systems reason, learn, and improve through evaluation and feedback. Join Outlier to contribute to AI that performs better in real-world scenarios, with flexible hours and the benefit of free access to leading LLMs.