Remote AI Evaluator — Spot Flaws & Earn Flexible Pay

Outlier; Glendale (AZ); Remote; USD 20,000 - 29,000; Full time

Benefits offered by this job

Earn up to $18 USD/hr

Flexible hours

Remote work

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image and video outputs, and explain what looked off in writing.

Remote work, flexible hours, and weekly cadence are offered, with pay reflecting expertise and project needs. Responsibilities include evaluating videos, images, and audio against prompts, providing structured feedback, and ensuring outputs meet quality standards.

Qualifications

• Fluent English speaker with strong written communication.
• Excellent attention to detail and ability to spot inconsistencies.
• Comfortable articulating observations in written form.
• Experience reviewing AI-generated media is a plus.

Responsibilities

• Holding live conversations with AI voice models and ranking their naturalness and usefulness.
• Comparing AI-generated images and videos against prompts to judge adherence to instructions.
• Inspecting outputs closely to spot distortions, artifacts, and misalignments.
• Writing concise, evidence-based explanations in English describing findings.

Skills

Fluent English

Attention to detail

Clear written communication

Comfortable with conversational speech

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, compare image and video outputs, and explain what looked off in writing.

Remote work, flexible hours, and weekly cadence are offered, with pay reflecting expertise and project needs. Responsibilities include evaluating videos, images, and audio against prompts, providing structured feedback, and ensuring outputs meet quality standards.