Remote AI Evaluator: Spot AI Missteps & Improve Models

Outlier; Madison (WI); Hybrid; USD 15,000 - 25,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, compare image/video outputs to prompts, and explain what looked off in writing, from home or while traveling.

Compensation includes up to $18 USD/hr with weekly payments and free access to leading LLMs. You can work from anywhere with no minimum hours, contributing to frontier AI research and real-world improvements.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in to spot issues.
• Nice to have a Bachelor's degree or above.
• Ability to think on your feet and explain decisions clearly.
• Experience writing short, evidence-based reviews.

Responsibilities

• Holding live conversations with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos to judge adherence to prompts.
• Inspecting outputs closely to spot problems like artifacts or mismatches.
• Rating outputs across dimensions and writing explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Written explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, compare image/video outputs to prompts, and explain what looked off in writing, from home or while traveling.

Compensation includes up to $18 USD/hr with weekly payments and free access to leading LLMs. You can work from anywhere with no minimum hours, contributing to frontier AI research and real-world improvements.