AI Response Evaluator — Remote, Flexible

Outlier; Lansing (MI); Remote; USD 15,000 - 25,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Free access to leading LLMs

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay conversations with AI voice models, compare images and videos, and explain what looked off or inconsistent. Work remotely with weekly payments and access to leading LLMs.

Your precise feedback helps improve AI systems and supports frontier research in real-world performance.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in when needed.
• Nice to have: Bachelor’s degree or above.
• Comfortable thinking on your feet and discussing realistic scenarios.
• Experience writing short, evidence-based explanations or reviews.
• Ability to decide clearly when both options have flaws.

Responsibilities

• Holding live conversations with AI voice models and rating naturalness and usefulness.
• Comparing AI-generated images/videos and judging adherence to prompts.
• Inspecting outputs closely to spot distortions, flicker, or mismatches and explain findings in writing.
• Writing explanations in English that pinpoint what was observed.

Skills

Fluent English

Attention to detail

Written communication

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay conversations with AI voice models, compare images and videos, and explain what looked off or inconsistent. Work remotely with weekly payments and access to leading LLMs.

Your precise feedback helps improve AI systems and supports frontier research in real-world performance.