Remote AI Evaluation Specialist — Flexible Hours

Outlier; Tempe (AZ); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Up to $18 USD/hr

Flexible hours

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, remotely and on your own schedule.

Work from home or while you travel, with flexible hours and weekly payments. You’ll rate outputs for adherence, quality and realism, and provide written explanations to help improve AI systems. Prior exposure to reviewing media is a plus.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and patience to replay or zoom in when needed.
• Experience writing concise, evidence-based explanations or reviews.
• Comfortable discussing realistic scenarios in a natural, conversational style.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rate how natural and clear they sound.
• Compare AI-generated images and videos to assess alignment with prompts and quality.
• Inspect outputs closely (zoom, replay) to spot problems like artifacts or mismatches.
• Provide written explanations highlighting what you saw or heard and why a choice was made.

Skills

Fluent English

Attention to detail

Clear written communication

Conversational ability

Explain evaluations clearly

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You’ll roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, remotely and on your own schedule.

Work from home or while you travel, with flexible hours and weekly payments. You’ll rate outputs for adherence, quality and realism, and provide written explanations to help improve AI systems. Prior exposure to reviewing media is a plus.