Remote AI Media Quality Evaluator

Outlier

Boca Raton (FL)

Remote

USD 21,000 - 29,000

Full time

14 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Weekly payments via ACH/PayPal/AirTM

Free access to leading LLMs

Earn up to $18 USD/hr

Job summary

Outlier is seeking detail‑oriented English speakers to review AI‑generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what seemed off, remotely and on your schedule.

Join Outlier’s evaluation loop to help improve AI systems and contribute to frontier research being translated into real‑world performance. Earn up to $18/hr with flexible hours and free access to leading LLMs.

Qualifications

Fluent English with clear written communication and natural conversational speech.
Strong attention to detail and patience to replay or zoom in when something seems off.
Bachelor's degree or above is nice to have.
Experience writing short, evidence‑based explanations or reviews.
Ability to decide clearly when both options have flaws.

Responsibilities

Holding live, scenario-based conversations in English with AI voice models and ranking naturalness, usefulness, and clarity.
Comparing AI-generated images and videos to judge which follows the prompt better.
Inspecting outputs closely (zooming in, replaying) to spot problems like distorted anatomy, flickering, or audio-video misalignment.
Writing detailed explanations in English describing what was seen or heard.