Remote AI Quality Evaluator

Outlier; Berkeley (CA); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Up to $15 USD/hr

Flexible schedule

Remote work from anywhere

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of a remote setup. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, helping AI systems improve in real-world scenarios.

Responsibilities include comparing AI-generated images and videos to prompts, inspecting outputs for distortions or misalignment, and providing concise, evidence-based explanations for each assessment.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and careful analysis.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot artifacts, distortions, or misalignments and explain findings in writing.

Skills

Fluent English

Attention to detail

Clear written communication

Think on your feet

Evidence-based explanations

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media from the comfort of a remote setup. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, helping AI systems improve in real-world scenarios.

Responsibilities include comparing AI-generated images and videos to prompts, inspecting outputs for distortions or misalignment, and providing concise, evidence-based explanations for each assessment.