Remote AI Evaluation & Annotation Specialist

Scale AI; City of Leduc; Remote; CAD 24,000 - 34,000; Part time

Benefits offered by this job

Flexible schedule

Weekly payments

Freelance/1099 contract

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media and roleplay live conversations with an AI voice model. You will score exchanges and explain issues, all remotely and on your own schedule.

This freelance, 1099 opportunity offers up to USD 15 per hour, with weekly payments and incentives. Applicants from multiple countries may apply, working fully remotely with flexible hours.

Qualifications

• Fluent English speaker with strong written communication.
• Strong attention to detail and ability to replay/zoom in when something seems off.
• Comfortable thinking on your feet and discussing realistic scenarios.
• Experience writing short, evidence-based explanations or reviews.
• Able to decide clearly when both options have flaws.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images/videos and judge which follows the prompt better.
• Inspect outputs closely to spot problems like distorted anatomy, flickering, or misaligned audio.
• Rate outputs across dimensions and write explanations in English detailing what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under imperfect info

Adaptability

Education

Bachelor’s degree or above (nice to have)

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media and roleplay live conversations with an AI voice model. You will score exchanges and explain issues, all remotely and on your own schedule.

This freelance, 1099 opportunity offers up to USD 15 per hour, with weekly payments and incentives. Applicants from multiple countries may apply, working fully remotely with flexible hours.