AI Quality Evaluator — Remote Flexible Hours Free LLM

Outlier

Fayetteville (AR)

Remote

USD 20,000 - 29,000

Full time

14 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours

Free access to leading LLMs

Weekly payments via ACH/PayPal

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, all remotely and on your own schedule.

At Outlier, your work helps shape AI that performs better in the real world. Earn up to $18/hr with flexible hours and access to leading LLMs.

Qualifications

Fluent English with clear written communication.
Excellent attention to detail and ability to replay or zoom in.
Nice to have: pursuing or holding a Bachelor's degree or above.
Comfortable thinking on your feet and discussing realistic situations.
Experience writing short, evidence-based explanations or reviews.
Able to make clear decisions when options have flaws.

Responsibilities

Holding live, scenario-based conversations in English with AI voice models, then ranking naturalness, usefulness, and clarity.
Comparing AI-generated images and videos and judging which follows the prompt better.
Inspecting outputs to spot problems like distorted anatomy, flickering, or misalignment.
Writing explanations in English that point to what you saw or heard.
Completing image/video evaluations and label captions as needed.
Evaluating audio and voice outputs for naturalness and accuracy.