AI Response Reviewer — Flexible, Remote Evaluation Work

Outlier; Madison (WI); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work from anywhere

Free access to leading LLMs

Weekly payments via ACH/PayPal/AirTM

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, fully remote schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked off in written form.

Full remote work with flexible hours, competitive hourly pay up to $18 and weekly payments. Access to leading LLMs and the ability to contribute to frontier AI research is provided.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay/zoom in to spot issues.
• Bachelor's degree or higher preferred.
• Comfortable thinking on your feet and discussing realistic scenarios.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely (zooming in, replay) to spot issues like distorted anatomy, flickering, or misaligned audio.
• Rating each output across dimensions and writing a concise explanation in English describing what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Conversational skills

Write concise reviews

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, fully remote schedule. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked off in written form.

Full remote work with flexible hours, competitive hourly pay up to $18 and weekly payments. Access to leading LLMs and the ability to contribute to frontier AI research is provided.