Remote AI Response Evaluator — Flexible Hours & Perks

Outlier; Irving (TX); Remote; USD 15,000 - 25,000; Part time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours

Remote from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will conduct live conversations with AI voice models, compare images and videos to judge which follows prompts best, and explain in writing what looked or sounded off, all remotely and on your schedule.

At Outlier, your input helps shape how AI systems reason, learn, and improve, contributing to frontier research and real-world AI performance.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in to verify issues.
• Bachelor's degree or above is a plus.
• Ability to think on your feet and explain realistic scenarios clearly.
• Experience writing short, evidence-based reviews is helpful.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models, then ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or misaligned audio.
• Writing a concise English explanation of what you observed and why it matters.

Skills

Fluent English

Attention to detail

Clear written communication

Situational reasoning

Decision making with flaws

Experience writing reviews

Comfortable discussing in natural way

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will conduct live conversations with AI voice models, compare images and videos to judge which follows prompts best, and explain in writing what looked or sounded off, all remotely and on your schedule.

At Outlier, your input helps shape how AI systems reason, learn, and improve, contributing to frontier research and real-world AI performance.