AI Evaluation Specialist — Remote, Flexible Hours

Outlier

Portland (ME)

Remote

USD 20,000 - 29,000

Full time

21 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Pay up to $18/hr

Flexible hours

Free access to LLMs

Job summary

Outlier is seeking detail-oriented reviewers to evaluate AI-generated media remotely and on a flexible schedule. You will engage in live conversations with AI voice models, compare image and video outputs, and judge adherence to prompts while writing precise explanations of observed issues.

Earn up to $18 USD/hr with the possibility of additional incentives and perks. Work from home or while traveling, with weekly payments via ACH, PayPal, or AirTM. Applicants from multiple countries are welcome.

Qualifications

Fluent English speaker with clear written communication and comfortable with natural conversational speech.
Strong attention to detail and patience to replay or zoom in when something seems off.
Experience writing short, evidence-based explanations or reviews.
Comfortable making clear decisions when both options have flaws.

Responsibilities

Hold live conversations with AI voice models and rank naturalness, usefulness, and clarity.
Compare AI-generated images and videos and judge which better follows the prompt.
Inspect outputs closely to spot issues like distorted anatomy, flicker, or mismatched audio.
Write a concise explanation in English pointing to what you saw or heard.