Remote AI Media Evaluator: Spot Errors & Improve Models

Outlier; Asheville (NC); Remote; USD 20,000 - 29,000; Part time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours from anywhere

Free access to leading LLMs

Weekly payments

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, fully remote schedule. You will roleplay conversations with AI voice models, rank outputs for naturalness and accuracy, and explain findings in writing.

Tasks include evaluating images, videos, and captions while focusing on prompt adherence and quality. As part of Outlier's evaluation loop, your analyses help improve AI systems.

Qualifications

• Fluent English with strong written communication skills.
• Good attention to detail and ability to replay or zoom in when something seems off.
• Experience writing concise, evidence-based explanations or reviews.
• Able to think clearly and decide when two options both have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos, judge which follows the prompt better.
• Inspect outputs to spot problems like distorted anatomy, flickering, or audio-video misalignment.
• Write a specific English explanation pointing to what was observed and why a choice was made.

Skills

Fluent English

Attention to detail

Clear written communication

Bachelor's degree or above

Quick thinker

Review writing experience

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, fully remote schedule. You will roleplay conversations with AI voice models, rank outputs for naturalness and accuracy, and explain findings in writing.

Tasks include evaluating images, videos, and captions while focusing on prompt adherence and quality. As part of Outlier's evaluation loop, your analyses help improve AI systems.