Remote AI Evaluation Specialist

Outlier; Greenville (SC); Hybrid; USD 17,000 - 24,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Up to $15/hr

Free access to leading LLMs

Weekly payments via ACH/PayPal/AirTM

1099 freelance contract

Job summary

Outlier is seeking detail-oriented English-speaking evaluators to review AI-generated media from home with flexible hours. You will conduct live conversations with AI voice models, compare image and video outputs, and explain what’s off in writing.

This is a remote, freelance role paying up to $15 USD/hr, with weekly paid invoices and additional incentives. As part of Outlier's evaluation loop, your feedback helps improve AI systems and their real-world performance.

Qualifications

• Fluent English with strong written communication and ability to explain observations clearly.
• Great attention to detail and willingness to review outputs closely.
• Experience writing concise, evidence-based explanations or reviews.
• Comfortable thinking on your feet and discussing realistic scenarios.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural, useful, and clear each one sounded.
• Comparing pairs of AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering or unnatural motion, text errors, and audio-video misalignment.
• Rating each output across dimensions like adherence, quality, and realism, then writing a written explanation in English.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Decision making under uncertainty

Education

Bachelor's degree or above

Job description

Outlier is seeking detail-oriented English-speaking evaluators to review AI-generated media from home with flexible hours. You will conduct live conversations with AI voice models, compare image and video outputs, and explain what’s off in writing.

This is a remote, freelance role paying up to $15 USD/hr, with weekly paid invoices and additional incentives. As part of Outlier's evaluation loop, your feedback helps improve AI systems and their real-world performance.