Remote AI Evaluator: Live Conversations & Media Review

Outlier; Minneapolis (MN); Hybrid; USD 17,000 - 24,000; Part time

Benefits offered by this job

Remote work

Flexible hours

Weekly payments via ACH/PayPal/AirTM

Free access to leading LLMs

Job summary

Outlier is hiring detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will hold live conversations with AI voice models, compare image and video outputs, and explain what looked or sounded off in writing.

You will rate and justify assessments, ensure accuracy, and contribute to improving AI systems. Paid weekly, with incentives and access to advanced LLMs. Remote, contract-based work available to applicants worldwide.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Strong attention to detail and patience to look and listen closely.
• Nice to have: Pursuing or holding a Bachelor's degree or above.
• Comfortable thinking on your feet and talking through realistic situations.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.
• Currently accepting applicants from: Australia, Canada, Ireland, United Kingdom, United States.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models, then ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs closely, zooming in and replaying to spot problems like distorted anatomy, flickering, motion, text errors, and audio-video mismatches.
• Rating each output across dimensions and writing a specific explanation in English explaining what you saw or heard.

Skills

Fluent English

Attention to detail

Strong writing

Decision making

Education

Bachelor's degree or above

Job description

Outlier is hiring detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will hold live conversations with AI voice models, compare image and video outputs, and explain what looked or sounded off in writing.

You will rate and justify assessments, ensure accuracy, and contribute to improving AI systems. Paid weekly, with incentives and access to advanced LLMs. Remote, contract-based work available to applicants worldwide.