Remote AI Evaluation Specialist

Scale AI; Summerside; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Work from anywhere

Free access to leading LLMs

Join 900K+ Outlier Experts across 52+"

Job summary

Scale AI's Outlier platform is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all remotely on your schedule.

You will assess AI outputs across images, videos, and audio, provide evidence-based explanations in writing, and help improve model performance. This is freelance, 1099 work with flexible hours and weekly payments.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and patience to replay or zoom in when something seems off.
• Able to think on your feet and discuss realistic situations clearly.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos to judge prompt adherence and quality.
• Inspect outputs to spot problems like distorted anatomy, flickering, or misaligned audio/video, then explain findings in writing.
• Provide evidence-based explanations pointing to observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under imperfectoptions

Education

Bachelor’s degree or above

Job description

Scale AI's Outlier platform is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked or sounded off, all remotely on your schedule.

You will assess AI outputs across images, videos, and audio, provide evidence-based explanations in writing, and help improve model performance. This is freelance, 1099 work with flexible hours and weekly payments.