Remote AI Quality Evaluator & Reviewer

Outlier; Amherst (MA); Remote; USD 17,000 - 28,000; Part time

Benefits offered by this job

Remote work

Flexible hours

Free LLM access

Weekly payments

Job summary

Outlier is hiring contractors to evaluate AI-generated media from home on your own schedule. You will hold live conversations with AI voice models, compare image and video outputs, and explain what looks or sounds off in writing.

This remote, flexible role helps shape how frontier AI systems perform in real-world use. Ideal applicants are fluent in English, detail-oriented, and able to write concise, evidence-based explanations.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail, patient to replay or zoom in on content.
• Experience writing concise, evidence-based explanations or reviews.
• Pursuing or holding a Bachelor’s degree or above preferred.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely to spot problems like distortions, flickering, or audio-video misalignment.
• Provide written explanations in English pointing to observed issues and provide clear rationale.
• Rate outputs across dimensions such as adherence, quality, and realism.

Skills

English fluency

Attention to detail

Written communication

Evidence-based reviews

Education

Bachelor's degree

Job description

Outlier is hiring contractors to evaluate AI-generated media from home on your own schedule. You will hold live conversations with AI voice models, compare image and video outputs, and explain what looks or sounds off in writing.

This remote, flexible role helps shape how frontier AI systems perform in real-world use. Ideal applicants are fluent in English, detail-oriented, and able to write concise, evidence-based explanations.