AI Output Quality Evaluator - Remote

Outlier; Minneapolis (MN); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Flexible hours

Remote work

Weekly payments

Free access to leading LLMs

Incentive opportunities

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, remotely and on your schedule.

Responsibilities include evaluating images, videos, and audio against prompts, and providing precise, English-language explanations to help improve AI systems. Flexible, remote work with weekly payments is available.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to replay or zoom in to spot issues.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making clear decisions when both options have flaws.

Responsibilities

• Hold live conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge prompt adherence.
• Inspect outputs closely (zoom/replay) to spot issues like distorted anatomy or mismatched audio.
• Write English explanations pointing to observed issues with specificity.

Skills

Fluent English

Attention to detail

Clear written communication

Review writing

Decision making with imperfect options

Education

Bachelor's degree or higher

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded off, remotely and on your schedule.

Responsibilities include evaluating images, videos, and audio against prompts, and providing precise, English-language explanations to help improve AI systems. Flexible, remote work with weekly payments is available.