Remote AI Evaluator: Live Chats & Media Quality Ratings

Outlier

Charlottesville (VA)

Hybrid

USD 15,000 - 25,000

Full time

14 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Earn up to $18 USD/hr

Flexible remote work

Free access to leading LLMs

Additional incentives / surge pricing

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will engage in live conversations with AI voice models, compare outputs, and explain what looked off, all remotely and on your own schedule.

Roleholders help shape how advanced AI systems reason and improve, contributing to a real-world evaluation loop. Multiple tasks include image/video evaluations and writing concise explanations in English.

Qualifications

Fluent English with strong written communication.
Excellent attention to detail and careful listening.
Ability to explain observations in writing.
Comfortable thinking on your feet in natural conversa tions.
Experience writing concise, evidence-based reviews.
Eligible to apply from multiple countries including the US.

Responsibilities

Holding live, scenario-based conversations with AI voice models and ranking naturalness and usefulness.
Comparing AI-generated images and videos to determine which better follows prompts.
Inspecting outputs closely, including zooming and replaying, to spot issues.
Rating outputs on adherence, quality, and realism, and writing explanations in English.