Remote AI Quality Evaluator & Feedback Specialist

Scale AI

Ajax

Remote

CAD 24,000 - 34,000

Part time

3 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible schedule

Free LLM access

Job summary

Outlier, a Scale AI company, seeks detail-oriented English speakers to review AI-generated media, roleplay live conversations with AI voice models, and score exchanges. You will compare image/video pairs, and explain in writing what looked or sounded off, all on your own schedule, remotely.

Responsibilities include rating outputs across adherence, quality, and realism, and writing concise explanations. This is a 1099 contract role with flexible hours, payment weekly via PayPal or ACH, and

Qualifications

Fluent English with clear written communication.
Strong attention to detail and patience to replay or zoom in when something seems off.
Comfortable thinking on your feet and talking through realistic scenarios.
Experience writing short, evidence-based explanations or reviews.
Ability to make clear decisions when both options have flaws.

Responsibilities

Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
Compare AI-generated images and videos and judge which follows the prompt better.
Inspect outputs closely to spot issues like distorted anatomy, flickering, or mismatched audio.
Provide written explanations detailing what you saw or heard and why a choice was made.