Remote AI Quality Evaluator — Flexible Hours & Up to $15/hr

Outlier; Provo (UT); Remote; USD 12,000 - 21,000; Full time

Benefits offered by this job

Weekly payments via ACH/PayPal/AirTM

Remote work from home

Flexible hours

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, compare images/videos for prompt adherence, and explain what looked or sounded off, all remotely and on your schedule.

We offer 100% remote work, flexible hours, and weekly payouts via ACH/PayPal/AirTM. Join a team shaping how AI systems reason and improve through evaluation feedback.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to replay/zoom in.
• Pursuing or holding a Bachelor's degree or above.
• Able to think on your feet and discuss realistic scenarios clearly.
• Experience writing short, evidence-based reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models.
• Rank how natural and useful each AI response sounds.
• Compare AI-generated images and videos and judge prompt adherence.
• Inspect outputs closely to spot distortions, flicker, or desynchronization.
• Write a specific, English explanation of what you saw or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Written explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, score exchanges, compare images/videos for prompt adherence, and explain what looked or sounded off, all remotely and on your schedule.

We offer 100% remote work, flexible hours, and weekly payouts via ACH/PayPal/AirTM. Join a team shaping how AI systems reason and improve through evaluation feedback.