Remote AI Response Evaluator — Flexible Hours

Outlier; Seattle (WA); Remote; USD 17,000 - 24,000; Full time

Job summary

Outlier is seeking detail-oriented evaluators to review AI-generated media and score exchanges in live conversations with AI voice models. You will compare image and video pairs, identify issues, and provide written explanations on what deviates from the prompt. This is a remote, contract-based opportunity with flexible hours.

Contributors help improve AI systems by assessing realism, adherence, and quality, on your schedule from anywhere worldwide, including the United States.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and the ability to articulate observations.
• Comfortable working remotely with flexible hours.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models.
• Ranking how natural and helpful each response sounds.
• Comparing AI-generated images and videos to prompts and detecting issues.
• Writing concise explanations in English describing what looked or sounded off.
• Evaluating outputs across adherence, quality, and realism.

Skills

Fluent English

Detail oriented

Clear written communication

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented evaluators to review AI-generated media and score exchanges in live conversations with AI voice models. You will compare image and video pairs, identify issues, and provide written explanations on what deviates from the prompt. This is a remote, contract-based opportunity with flexible hours.

Contributors help improve AI systems by assessing realism, adherence, and quality, on your schedule from anywhere worldwide, including the United States.