AI Evaluation Specialist (English) — Remote & Flexible

Outlier; Aurora; Remote; CAD 24,000 - 34,000; Full time

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay with AI voice models, compare image and video outputs, and explain in writing what looked off, all on your own schedule.

Earn up to $15 USD per hour with weekly payments. Access leading LLMs and work from anywhere with flexible hours. Your evaluations help improve AI systems used in frontier research.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to replay or zoom in when something looks off.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking how natural and useful each sounded.
• Comparing AI-generated images and videos and judging which better follows the prompt.
• Inspecting outputs closely to spot problems like distorted anatomy, flickering, or audio-video misalignment.
• Writing a concise English explanation that points to what was seen or heard.

Skills

Fluent English

Attention to detail

Written communication

Independent work

Education

Bachelor's degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote basis. You will roleplay with AI voice models, compare image and video outputs, and explain in writing what looked off, all on your own schedule.

Earn up to $15 USD per hour with weekly payments. Access leading LLMs and work from anywhere with flexible hours. Your evaluations help improve AI systems used in frontier research.