AI Response Evaluator — Remote, Flexible Hours, Free LLM Access

Outlier; Missoula (MT); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Hourly pay up to 18 USD

Flexible hours

Free LLM access

Incentive programs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible basis. You will roleplay conversations with AI voice models, compare image/video outputs, and provide written explanations of what went wrong, all on your schedule.

At Outlier, your evaluations help shape how advanced AI systems reason and learn, contributing to real-world improvements. Competitive hourly pay and access to leading LLMs are included, with payments weekly via multiple

Qualifications

• Fluent English with clear written communication and comfortable with everyday conversational speech.
• Strong attention to detail and ability to replay or zoom in to spot issues.
• Experience writing short, evidence-based explanations or reviews.
• Currently accepting applicants from: Australia, Canada, Ireland, United Kingdom, United States.

Responsibilities

• Holding live conversations with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing pairs of AI-generated images and videos to judge adherence to prompts.
• Inspecting outputs closely for issues like distorted anatomy, flickering, or audio/video misalignment.
• Writing a concise, English explanation that highlights what was seen or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Ability to explain observations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible basis. You will roleplay conversations with AI voice models, compare image/video outputs, and provide written explanations of what went wrong, all on your schedule.

At Outlier, your evaluations help shape how advanced AI systems reason and learn, contributing to real-world improvements. Competitive hourly pay and access to leading LLMs are included, with payments weekly via multiple