Remote AI Evaluation Specialist - English

Outlier

Naperville (IL)

Remote

USD 12,000 - 21,000

Full time

14 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Weekly payments (ACH/PayPal/AirTM)

Free access to leading LLMs

Remote work with flexible hours

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of your home. You will roleplay live conversations with an AI voice model, score exchanges for naturalness and usefulness, and explain in writing what looked or sounded wrong.

Contributors review pairs of AI-generated images and videos, assess prompt adherence, and provide concise explanations in English. This is a freelance, 1099 opportunity with flexible hours and weekly payments.

Qualifications

Fluent English with clear written communication and comfortable with natural conversation.
Strong attention to detail, patience to replay or zoom in when something seems off.
Bachelor's degree or above is nice to have.
Able to think on your feet and discuss realistic scenarios in a natural way.
Experience writing short, evidence-based explanations or reviews.

Responsibilities

Hold a live, scenario-based conversation in English with AI voice models and rank how natural, useful, and clear each sounded.
Compare pairs of AI-generated images and videos and judge which better follows the prompt.
Inspect outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
Rate outputs across dimensions like adherence, quality, and realism and write a concise English explanation highlighting observed issues.