Remote AI Evaluation Specialist

Outlier; Stockton (CA); Remote; USD 17,000 - 24,000; Part time

Benefits offered by this job

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, remote schedule. You will hold live conversations with AI voice models, compare image/video pairs, and explain what’s off, all from home. This 1099 contract opportunity pays up to $15/hr and includes weekly payments.

You’ll contribute to shaping how AI systems reason and improve, with access to leading LLMs. Ideal candidates are fluent in English, with a strong eye for detail and experience writing

Qualifications

• Fluent English with clear written communication and comfort with everyday conversation.
• Strong attention to detail; ability to replay or zoom in when something seems off.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot issues like distortions, flickering, text errors, or misaligned audio.
• Rating outputs across dimensions and writing a concise English explanation of findings.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under ambiguity

Evidence-based explanations

Education

Bachelor's degree or above

Pursuing or holding a BA/BS

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a flexible, remote schedule. You will hold live conversations with AI voice models, compare image/video pairs, and explain what’s off, all from home. This 1099 contract opportunity pays up to $15/hr and includes weekly payments.

You’ll contribute to shaping how AI systems reason and improve, with access to leading LLMs. Ideal candidates are fluent in English, with a strong eye for detail and experience writing