Remote AI Quality Evaluator — Flexible Hours

Outlier; Boise (ID); Hybrid; USD 14,000 - 21,000; Part time

Benefits offered by this job

Flexible hours

Remote work from home or while travel

Free access to leading LLMs

Weekly payments via ACH/PayPal/AirTM

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked off in writing, all on your own schedule and from home or while traveling.

Responsibilities include evaluating images, videos, and audio, comparing outputs to prompts, and providing concise, evidence-based explanations to help improve AI systems. Flexible hours and weekly payments offered.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and the ability to replay or zoom in when something seems off.
• Pursuing or holding a Bachelor's degree or higher.
• Comfortable thinking on your feet and explaining realistic situations clearly.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking naturalness, usefulness, and clarity.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio-video mismatches.
• Writing a detailed English explanation pointing to what you saw or heard.

Skills

Fluent English

Attention to detail

Think on your feet

Clear decision making

Concise explanations

Education

Bachelor’s degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay live conversations with AI voice models, score exchanges, and explain what looked off in writing, all on your own schedule and from home or while traveling.

Responsibilities include evaluating images, videos, and audio, comparing outputs to prompts, and providing concise, evidence-based explanations to help improve AI systems. Flexible hours and weekly payments offered.