Remote AI Quality Evaluator — Flexible Hours

Outlier

United States

Remote

USD 20,000 - 29,000

Full time

17 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on your own schedule. You will roleplay live conversations with AI voice models, compare image and video outputs, and explain in writing what looked or sounded off. Work from anywhere with flexible hours and weekly payments.

Responsibilities include evaluating image, video, and audio outputs, and providing concise, evidence-based explanations to help improve AI systems.

Qualifications

Fluent English with clear written communication.
Strong attention to detail; patience to replay or zoom in.
Bachelor's degree or higher is preferred.
Capable of thinking on your feet and explaining decisions.
Experience writing concise, evidence-based reviews.
Ability to decide when both options have flaws.
Applicants from Australia, Canada, Ireland, United Kingdom, or United States.

Responsibilities

Hold live conversations with AI voice models and rank naturalness and clarity.
Compare AI-generated images and videos and judge prompt adherence.
Inspect outputs for distortions, flicker, text errors, or audio-video mismatch.
Write explicit explanations in English highlighting observations.
Image evaluations: compare two AI-generated images for a prompt and pick the better one.
Video evaluations: rank AI videos against a prompt.
Video caption labeling: describe actions in first-person videos with precise captions.
Audio and voice evaluations: rate naturalness and pronunciation.