AI Response Evaluator - Remote & Flexible Hours

Outlier; Dallas (TX); Remote; USD 20,000 - 29,000; Part time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Weekly payments

Job summary

Outlier invites detail-oriented English speakers to review AI-generated media. You’ll hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely on your own schedule.

Expect to evaluate outputs for naturalness and adherence, rate across dimensions, and write concise explanations in English. The role is fully remote with flexible hours and weekly payments up to $18 per hour, plus incentives.

Qualifications

• Fluent English with clear written communication and natural conversational ability.
• Excellent attention to detail and ability to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.
• Willingness to think quickly and discuss realistic scenarios.
• Nice to have: pursuing or holding a Bachelor's degree or above.

Responsibilities

• Holding live, scenario-based conversations with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or mismatched audio.
• Writing specific explanations in English that point to observed issues.

Skills

Fluent English

Attention to detail

Experience writing explanations

Decision-making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier invites detail-oriented English speakers to review AI-generated media. You’ll hold live conversations with AI voice models, compare image and video pairs, and explain what’s off, all remotely on your own schedule.

Expect to evaluate outputs for naturalness and adherence, rate across dimensions, and write concise explanations in English. The role is fully remote with flexible hours and weekly payments up to $18 per hour, plus incentives.