AI Response Evaluator — Remote, Flexible Hours

Outlier; Lexington (KY); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Free access to leading LLMs

Weekly payments via ACH, PayPal andAir

Job summary

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image/video pairs, and explain in writing what looked or sounded wrong, all remotely and on your schedule.

Work from home with flexible hours and earnings up to $18 per hour, plus incentives. You will gain free access to leading LLMs and contribute to a feedback loop shaping AI systems for real-world performance.

Qualifications

• Fluent English with strong, clear written communication.
• Attention to detail and the ability to replay or zoom in on material.
• Nice to have: pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and explaining realistic scenarios.
• Experience writing short, evidence-based explanations or reviews.
• Able to decide clearly when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs for issues like distortions, flickering, text errors, or audio-video misalignment; explain what was off in writing.

Skills

Fluent English

Clear written communication

Attention to detail

Comfortable with conversational speech

Decision making under ambiguity

Experience writing explanations

Education

Bachelor's degree or above

Job description

Outlier is hiring detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image/video pairs, and explain in writing what looked or sounded wrong, all remotely and on your schedule.

Work from home with flexible hours and earnings up to $18 per hour, plus incentives. You will gain free access to leading LLMs and contribute to a feedback loop shaping AI systems for real-world performance.