Remote AI Evaluation Specialist (English) — Flexible Hours

Scale AI; Sarnia; Remote; CAD 24,000 - 34,000; Part time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Global community of experts

Job summary

Outlier, a Scale AI-backed AI training platform, is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, compare visuals, and write concise justifications, all on your own schedule from anywhere.

Earn up to USD 15 per hour as project work, with additional incentives and a weekly payment schedule via PayPal, AirTM, or ACH.

Qualifications

• Fluent English speaker with strong written communication.
• Great attention to detail and ability to replay or zoom in when something seems off.
• Comfortable thinking on your feet and discussing realistic situations.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely to spot problems like distortions, flickering, or misaligned audio/video.
• Rate outputs across dimensions (adherence, quality, realism) and write specific explanations.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making when flaws exist

Experience writing explanations/review

Education

Bachelor's degree or above

Job description

Outlier, a Scale AI-backed AI training platform, is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, compare visuals, and write concise justifications, all on your own schedule from anywhere.

Earn up to USD 15 per hour as project work, with additional incentives and a weekly payment schedule via PayPal, AirTM, or ACH.