AI Evaluation Specialist – Remote & Flexible Hours

Outlier; Glendale (AZ); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to LLMs

Incentive bonuses

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges for prompt adherence, and explain in writing what looked or sounded off, all remotely on your own schedule.

Join Outlier to help shape how advanced AI systems reason and improve, contributing to AI that performs better in real-world use. Remote work with flexible hours and competitive pay.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and the ability to replay or zoom in when something is off.
• Bachelor’s degree or higher preferred.
• Experience writing concise, evidence-based explanations or reviews.
• Ability to decide clearly when both options have flaws.

Responsibilities

• Hold live conversations with AI voice models, then rank how natural and clear each sounded.
• Compare AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely to spot problems like distorted visuals or misaligned audio.
• Write a specific English explanation pointing to what you saw or heard.

Skills

Fluent English

Attention to detail

Written clarity

Decision making

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges for prompt adherence, and explain in writing what looked or sounded off, all remotely on your own schedule.

Join Outlier to help shape how advanced AI systems reason and improve, contributing to AI that performs better in real-world use. Remote work with flexible hours and competitive pay.