Remote AI Evaluation Specialist — Flexible Hours

Outlier

Louisville (KY)

Remote

USD 20,000 - 29,000

Full time

14 hours ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible hours

Weekly payments

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a remote, flexible schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked or sounded off in writing.

Tasks include comparing images and videos to the prompt and rating adherence, quality, and realism. Join a program that gives you free access to leading LLMs, with weekly payments and the potential to earn up to $18 per hour.

Qualifications

Fluent English with clear written communication and comfortable with natural conversational speech.
Strong attention to detail and patience to replay or zoom in when something seems off.
Pursuing or holding a Bachelor's degree or above.
Able to think on your feet and discuss realistic situations naturally.
Experience writing short, evidence-based explanations or reviews.
Capable of making clear decisions when both options have flaws.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models and ranking naturalness and usefulness.
Comparing AI-generated images and videos and judging adherence to prompts.
Inspecting outputs closely to spot distortions, motion issues, text errors, and misaligned audio.
Writing a specific English explanation pointing to what you saw or heard.