AI Evaluation Specialist — Remote & Flexible Hours

Outlier

Sioux Falls (SD)

Hybrid

USD 20,000 - 29,000

Full time

43 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Free access to leading LLMs

Flexible hours

Weekly payments via ACH, PayPal andAir

Earn up to $18 USD/hr

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will hold live conversations with an AI voice model, compare image and video outputs, and explain in writing what looked off.

All work remotely and on your own schedule, with weekly payments and diverse projects. You will rate responses for naturalness, adherence to prompts, and realism, then provide concise explanations in English.

Qualifications

Fluent English with clear written communication and comfortable with everyday conversational speech.
Strong attention to detail and patience to replay or zoom in when something seems off.
Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural and clear each one sounded.
Comparing AI-generated images and videos and judging which follows the prompt better.
Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
Rating each output across dimensions like adherence, quality, and realism, then writing a specific explanation in English.