AI Evaluation Specialist (English) — Remote & Flexible

Outlier

Portland (OR)

Remote

USD 17,000 - 24,000

Full time

23 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Fully remote

Flexible hours

1099 contract

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will interact with AI voice models, compare image/video pairs, and explain what looks off, all on a flexible schedule.

Responsibilities include live conversations, evaluating outputs for realism and prompt adherence, and writing concise explanations in English. This is a 1099 contract with pay up to $15/hr, offering remote work and flexible hours.

Qualifications

Fluent English with clear written communication.
Strong attention to detail and the ability to replay or zoom in when something looks off.
Nice to have: pursuing or holding a Bachelor's degree or above.
Comfortable thinking on your feet and explaining realistic scenarios in natural conversation.
Experience writing short, evidence-based explanations or reviews.

Responsibilities

Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
Comparing AI-generated images and videos and judging adherence to prompts.
Inspecting outputs closely to spot problems like distorted anatomy, flickering, or audio-video mismatches.
Rating outputs on dimensions like adherence, quality, and realism and writing explanations in English.