Remote AI Evaluator: Spot Flaws & Improve Models

Outlier; West Lafayette (IN); Hybrid; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Weekly payments (ACH, PayPal, AirTM)

Free access to leading LLMs

Job summary

Outlier is seeking detail‑oriented English speakers to review AI-generated media from home on a flexible schedule. You’ll engage in live conversations with AI voice models, compare image/video outputs, and explain what’s off in writing. Your work helps improve AI systems and supports frontier research.

You’ll review text and visual prompts, rate adherence and quality, and receive weekly payments. This freelance, 1099 role supports partial or full-time engagement with potential incentives.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and careful listening.
• Ability to explain observations clearly in writing.
• Comfort with providing structured explanations for complex prompts.
• Open to freelance, remote work with flexible hours.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models.
• Ranking naturalness and usefulness of outputs and explaining why.
• Comparing AI-generated images and videos for prompt adherence.
• Inspecting outputs closely to spot issues like artifacts or misalignment.
• Writing concise, evidence-based explanations in English.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Quick learner

Education

Bachelor’s degree or above (nice to have)

Job description

Outlier is seeking detail‑oriented English speakers to review AI-generated media from home on a flexible schedule. You’ll engage in live conversations with AI voice models, compare image/video outputs, and explain what’s off in writing. Your work helps improve AI systems and supports frontier research.

You’ll review text and visual prompts, rate adherence and quality, and receive weekly payments. This freelance, 1099 role supports partial or full-time engagement with potential incentives.