Remote AI Response Evaluator - Flexible Hours

Outlier; Hartford (CT); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Weekly payments

Flexible schedule

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate how well responses follow prompts. You will engage in live, scenario-based conversations with AI voice models and compare image and video outputs, then explain what looked or sounded off.

Work remotely on a flexible schedule from anywhere. Rates vary by expertise, with weekly payments via ACH, PayPal and AirTM, and access to leading LLMs at no cost.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in to spot issues.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models, then ranking naturalness, usefulness, and clarity.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely (zoom/replay) to spot problems like distorted anatomy, flickering, text errors, or audio-video mismatch.
• Rating outputs on adherence, quality, and realism, then writing a specific explanation in English.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under ambiguity

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and rate how well responses follow prompts. You will engage in live, scenario-based conversations with AI voice models and compare image and video outputs, then explain what looked or sounded off.

Work remotely on a flexible schedule from anywhere. Rates vary by expertise, with weekly payments via ACH, PayPal and AirTM, and access to leading LLMs at no cost.