Remote AI Quality Evaluator

Scale AI

Kingston

Remote

CAD 24,000 - 34,000

Full time

4 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible schedule

Remote work from anywhere

Free access to leading LLMs

Global community of experts

Job summary

Outlier, an AI training platform operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges for naturalness and usefulness.

You will compare AI-generated images and videos to prompts, explain in writing what looked or sounded wrong, and work remotely with a flexible schedule. Payments are issued weekly with variable incentives.

Qualifications

Fluent English speaker with strong written communication and comfort with natural conversational speech.
Excellent attention to detail and ability to replay or zoom in when something seems off.
Able to think on your feet and discuss realistic scenarios naturally.
Experience writing concise, evidence-based explanations or reviews.
Able to make clear decisions when both options have flaws.

Responsibilities

Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
Compare pairs of AI-generated images and videos and judge which follows the prompt better.
Inspect outputs closely to spot issues like distorted anatomy, flickering, text errors, or audio-video misalignment.
Write a specific explanation in English detailing what you saw or heard and why your rating was given.