Remote AI Quality Evaluator & Feedback Specialist

Scale AI

Summerside

Hybrid

CAD 17,000 - 29,000

Part time

3 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Flexible schedule

Remote work

Free access to leading LLMs

Global expert community

Job summary

Outlier, a Scale AI-backed AI training platform, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and explain what looked off, all remotely on your own schedule.

Responsibilities include evaluating images, videos, captions, and audio; comparing pairs to judge adherence to prompts; and providing concise, evidence-based explanations in English. Flexible, remote freelance work with global reach.

Qualifications

Fluent English with clear written communication
Strong attention to detail and ability to replay or zoom in to spot issues
Experience writing brief, evidence-based explanations or reviews
Able to make clear decisions when options have flaws

Responsibilities

Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness and clarity
Compare pairs of AI-generated images and videos and judge which follows prompts better
Inspect outputs closely to spot problems like artifacts, distortions or mismatched audio/video
Write concise explanations in English detailing what was observed and why a choice was made