AI Evaluation Specialist - Remote & Flexible

Scale AI; Brampton; Hybrid; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule, no minimum hours

Global community of experts

Job summary

Scale AI's Outlier platform is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank naturalness, and explain what looked off.

Contributors work remotely on their own schedule, earning up to USD 15 per hour with additional incentives. This freelance, 1099 opportunity lets you set hours and join a growing community of experts.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and ability to replay and zoom in.
• Ability to explain findings in writing with evidence.
• Comfortable making decisions when options have flaws.
• Bachelor’s degree or higher preferred.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness.
• Compare pairs of AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely; spot distortions, flickering, or audio-video mismatches.
• Write a concise, evidence-based explanation of findings in English.

Skills

Attention to detail

English fluency

Written communication

Decision making

Evidence-based reviews

Education

Bachelor’s degree or higher preferred

Job description

Scale AI's Outlier platform is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank naturalness, and explain what looked off.

Contributors work remotely on their own schedule, earning up to USD 15 per hour with additional incentives. This freelance, 1099 opportunity lets you set hours and join a growing community of experts.