Remote AI Model Quality Evaluator – Flexible Hours

Scale AI; Airdrie; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Global community of experts

Weekly payments

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media remotely. You will roleplay conversations with an AI voice model, score exchanges, compare AI-generated media, and write concise explanations of observed issues.

Responsibilities include ranking naturalness and usefulness, inspecting outputs for errors, and providing clear, evidence-based writeups. This freelance role offers flexible schedule with payments weekly.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Strong attention to detail, with patience to listen closely and replay when needed.
• Comfortable thinking on your feet and describing realistic scenarios clearly.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows the prompt better.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, or misaligned audio.
• Provide written explanations pointing to what you saw or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Evaluating AI outputs

Explain in writing

Education

Bachelor's degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media remotely. You will roleplay conversations with an AI voice model, score exchanges, compare AI-generated media, and write concise explanations of observed issues.

Responsibilities include ranking naturalness and usefulness, inspecting outputs for errors, and providing clear, evidence-based writeups. This freelance role offers flexible schedule with payments weekly.