AI QA Evaluator - Remote & Flexible Hours

Outlier

Southwestern Ontario

Remote

CAD 17,000 - 29,000

Full time

2 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hourly pay up to $15

Weekly payments

Flexible hours

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media by holding live conversations with AI voice models, scoring exchanges, comparing images and videos to judge prompt adherence, and explaining what looked or sounded wrong, all remotely and on your own schedule. At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve.

This is a 1099 contract opportunity with flexible hours and weekly payments, offering the chance to work from home or

Qualifications

Fluent English with clear written communication.
Strong attention to detail and ability to replay or zoom in.
Experience writing short, evidence-based explanations or reviews.
Comfortable making clear decisions when options have flaws.

Responsibilities

Holding a live, scenario-based conversation in English with AI voice models, then ranking how natural and clear each sounded.
Comparing AI-generated images and videos and judging which follows the prompt better.
Inspecting outputs closely to spot issues like distorted anatomy, flickering, text errors, or audio-video mismatches.
Rating outputs across dimensions and writing specific English explanations.