AI Quality Evaluator — Remote & Flexible Hours

Outlier; Fort Worth (TX); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Free access to leading LLMs

Weekly payments via ACH/PayPal/AirTM

Flexible, remote work hours

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, compare image and video outputs, and explain in writing what was off, remotely and on your own schedule.

You will help shape AI systems by evaluating naturalness, usefulness, and adherence to prompts, then contribute precise, written feedback to guide improvements.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Great attention to detail and patience to replay or zoom in when something seems off.
• Bachelor’s degree or above preferred.
• Ability to think on your feet and discuss realistic situations naturally.
• Experience writing short, evidence-based explanations or reviews.
• Ability to make clear decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or misaligned audio.
• Rating outputs across dimensions and writing explanations in English detailing what was observed.

Skills

Fluent English

Clear written communication

Attention to detail

Evidence-based explanations

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, compare image and video outputs, and explain in writing what was off, remotely and on your own schedule.

You will help shape AI systems by evaluating naturalness, usefulness, and adherence to prompts, then contribute precise, written feedback to guide improvements.