Remote AI Quality Evaluator - Flexible Hours

Outlier; State College (Centre County); Remote; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Weekly pay

Job summary

Outlier is offering a fully remote, flexible-hours role to review AI-generated media. You will hold live conversations with AI voice models, compare image/video pairs, and explain what’s off, all on your schedule from anywhere.

Payments are weekly via ACH/PayPal/AirTM and can include incentives. Ideal candidates are fluent English speakers with strong attention to detail and proven ability to write concise explanations.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Strong attention to detail and ability to look and listen closely, replaying or zooming in when something seems off.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing pairs of AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or audio-visual misalignment.
• Rating outputs across dimensions like adherence, quality, and realism and writing a concise English explanation.

Skills

Fluent English

Education

Bachelor's degree or above

Job description

Outlier is offering a fully remote, flexible-hours role to review AI-generated media. You will hold live conversations with AI voice models, compare image/video pairs, and explain what’s off, all on your schedule from anywhere.

Payments are weekly via ACH/PayPal/AirTM and can include incentives. Ideal candidates are fluent English speakers with strong attention to detail and proven ability to write concise explanations.