Remote AI Evaluation Specialist

Scale AI; Red Deer; Hybrid; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert network

Job summary

Outlier, an AI training platform by Scale AI, seeks detail-oriented English speakers to rate live AI conversations, compare AI-generated media, and provide written explanations. Tasks are remote with flexible scheduling.

You’ll review prompts, evaluate how well outputs follow instructions, and write explanations of any errors across audio, image, and video tasks. This freelance opportunity offers weekly payments and performance incentives.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and patience.
• Ability to discuss real scenarios in natural speech.
• Experience writing evidence-based reviews.
• Bachelor’s degree or higher preferred.

Responsibilities

• Hold live, scenario-based English conversations with AI voice models.
• Rank AI outputs for adherence, quality, and realism.
• Write concise, evidence-based explanations of results.
• Compare AI-generated images/videos to assess prompt adherence.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Written explanations

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform by Scale AI, seeks detail-oriented English speakers to rate live AI conversations, compare AI-generated media, and provide written explanations. Tasks are remote with flexible scheduling.

You’ll review prompts, evaluate how well outputs follow instructions, and write explanations of any errors across audio, image, and video tasks. This freelance opportunity offers weekly payments and performance incentives.