Remote AI Quality Evaluator

Outlier; Wilmington (DE); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Weekly payments

Access to AI tools

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and provide written explanations of what looks off. You will hold live conversations with AI voice models, compare image and video outputs, and assess adherence to prompts, all remotely and on your own schedule.

Contributors earn up to $15 USD per hour, with weekly payments and additional incentives. This is a fully remote, flexible-hours opportunity with access to leading LLMs for the evaluation process.

Qualifications

• Fluent written and verbal English communication.
• Strong attention to detail, with patience to replay or zoom in to spot issues.
• Common sense about how content should be written and explained clearly.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which one better follows the prompt.
• Inspecting outputs closely—zooming in and replaying—to spot problems like distorted anatomy, flickering, or audio-video misalignment.
• Rating each output across dimensions like adherence, quality, and realism, then writing a concise English explanation of what you observed.

Skills

Fluent English

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and provide written explanations of what looks off. You will hold live conversations with AI voice models, compare image and video outputs, and assess adherence to prompts, all remotely and on your own schedule.

Contributors earn up to $15 USD per hour, with weekly payments and additional incentives. This is a fully remote, flexible-hours opportunity with access to leading LLMs for the evaluation process.