Remote Freelance AI Evaluator — Live Dialog & Media Review

Scale AI; Guelph; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Join 900K+ Outlier Experts

Collaborate with experts

Job summary

Outlier, an AI evaluation platform, seeks detail-oriented English speakers to review AI-generated media. Work remotely on your own schedule, ranking outputs, comparing images and videos, and writing concise explanations of issues found.

You will evaluate text, audio, image, and video outputs, rating adherence, quality, and realism, and provide evidence-based feedback. Payment is hourly with weekly processing.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making a clear decision when both options have flaws.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking realism.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot issues like artifacts, distortions, or misalignment.
• Writing a concise explanation in English detailing what looked or sounded wrong.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Evidence-based writing

Education

Bachelor’s degree or above

Job description

Outlier, an AI evaluation platform, seeks detail-oriented English speakers to review AI-generated media. Work remotely on your own schedule, ranking outputs, comparing images and videos, and writing concise explanations of issues found.

You will evaluate text, audio, image, and video outputs, rating adherence, quality, and realism, and provide evidence-based feedback. Payment is hourly with weekly processing.