Remote AI Evaluation Specialist

Scale AI; Summerside; Remote; CAD 17,000 - 29,000; Part time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

High-earning potential with incentives

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and rate outputs, comparing images and videos to prompts, and explain issues in writing.

Work remotely on your own schedule and earn up to USD 15 per hour with small incentive boosts. Applicants from multiple countries including Canada are welcome.

Qualifications

• Fluent English speaker with strong written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Able to think on your feet and discuss realistic scenarios naturally.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare pairs of AI-generated images/videos and judge which follows prompts better.
• Inspect outputs closely to spot problems like distorted anatomy, flickering, or audio mismatch.
• Write explanations in English pointing to what you saw or heard and rate outputs on accountability and quality.

Skills

Fluent English

Attention to detail

Clear written communication

Decision-making under uncertainty

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and rate outputs, comparing images and videos to prompts, and explain issues in writing.

Work remotely on your own schedule and earn up to USD 15 per hour with small incentive boosts. Applicants from multiple countries including Canada are welcome.