Remote AI Output Quality Evaluator — Flexible Hours

Outlier; Saint Paul (MN); Remote; USD 17,000 - 25,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

Free LLM access

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay conversations with AI voice models, compare image and video outputs, and explain in writing what looked off or inconsistent with the prompt.

Your insights help improve how advanced AI systems reason and respond in real-world tasks. Contributors work remotely, with payments on a weekly basis via ACH, PayPal, or AirTM, and with access to leading LLMs as part of the

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in to spot issues.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness and usefulness.
• Compare pairs of AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, or audio-video mismatch.
• Write a clear, English explanation highlighting what was off in each interaction.

Skills

Fluent English

Attention to detail

Written communication

Decision making

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will roleplay conversations with AI voice models, compare image and video outputs, and explain in writing what looked off or inconsistent with the prompt.

Your insights help improve how advanced AI systems reason and respond in real-world tasks. Contributors work remotely, with payments on a weekly basis via ACH, PayPal, or AirTM, and with access to leading LLMs as part of the