Remote AI Response Evaluator — Flexible Hours

Outlier; Charlottesville (VA); Remote; USD 15,000 - 25,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media, holding live conversations with AI voice models and explaining what’s off. You will compare image and video pairs and assess which follows prompts more accurately, all remotely and on your own schedule.

Participants rate outputs on adherence, quality, and realism, and write specific explanations in English to help improve AI systems for real-world use.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and the ability to replay or zoom in when something seems off.
• Comfortable thinking on your feet and discussing realistic situations conversationally.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models, then ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely (zoom/replay) to spot issues like distorted anatomy, glitches, or audio/video mismatch.
• Rating outputs across dimensions and writing a concise English explanation of findings.

Skills

Fluent English

Attention to detail

Conversational thinking

Evidence-based explanations

Clear decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media, holding live conversations with AI voice models and explaining what’s off. You will compare image and video pairs and assess which follows prompts more accurately, all remotely and on your own schedule.

Participants rate outputs on adherence, quality, and realism, and write specific explanations in English to help improve AI systems for real-world use.