Remote AI Evaluation Specialist — Flexible Schedule

Outlier Ai

United States

Remote

USD 17,000 - 24,000

Full time

2 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible schedule

No minimum hours

Free access to leading LLMs

Weekly payments via PayPal / ACH

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.

At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve. This is a freelance/independent contractor role with flexible hours and weekly payments, with access to leading LLMs.

Qualifications

Fluent English with clear written communication.
Strong attention to detail and patience to replay or zoom in when something seems off.
Able to think on your feet and articulate decisions in realistic scenarios.
Experience writing concise, evidence-based explanations or reviews.
Willing to make clear decisions when options have flaws.

Responsibilities

Hold live English conversations with AI voice models and rank naturalness, usefulness, and clarity.
Compare AI-generated images and videos and judge which follows the prompt better.
Inspect outputs closely to spot problems like distorted anatomy, flickering, or misalignment.
Rate outputs across dimensions and write English explanations detailing findings.