Remote AI Quality Evaluator — Flexible Hours

Scale AI; Steinbach; Remote; CAD 21,000 - 35,000; Full time

Job summary

Outlier is seeking detail-oriented, fluent English speakers to help train AI models through live conversations, evaluations, and written feedback. This freelance, remote role offers flexible hours and requires you to work independently with high attention to accuracy and clear explanations.

You will rate how natural and useful AI prompts sound, compare AI-generated images and videos for prompt adherence, and describe findings in English with concise, evidence-based notes.

Qualifications

• Fluent English with clear written communication.
• Pursuing or holding a Bachelor's degree or above.
• Strong attention to detail and ability to replay/zoom to inspect outputs.
• Comfortable thinking on your feet and discussing scenarios.
• Experience writing concise, evidence-based explanations or reviews.
• Able to decide clearly when options have flaws.

Responsibilities

• Hold live scenario-based English conversations with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs for issues like distorted anatomy, flicker, text errors, or audio-video mismatch.
• Rate outputs across dimensions and write concise explanations in English.

Skills

Fluent English

Bachelor’s degree

Attention to detail

Think on your feet

Explanations writing

Decision-making

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented, fluent English speakers to help train AI models through live conversations, evaluations, and written feedback. This freelance, remote role offers flexible hours and requires you to work independently with high attention to accuracy and clear explanations.

You will rate how natural and useful AI prompts sound, compare AI-generated images and videos for prompt adherence, and describe findings in English with concise, evidence-based notes.