Remote AI Response Evaluator & Quality Reviewer

Scale AI; Lethbridge; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Remote freelance contract

Access to leading LLMs

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail‑oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, and explain issues in writing from home on your schedule.

Ideal candidates are fluent in English, highly detail‑oriented, and able to make clear decisions when faced with imperfect options. Remote, freelance opportunities with flexible hours.

Qualifications

• Fluent English with strong, clear written communication.
• Excellent attention to detail and patience to replay or zoom in on issues.
• Comfortable thinking on your feet and discussing realistic situations in natural conversation.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.
• Nice to have: pursuing or holding a Bachelor’s degree or above.

Responsibilities

• Hold a live, scenario-based conversation in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge adherence to the prompt.
• Inspect outputs closely to spot problems like distorted anatomy, flickering, or audio mismatches.
• Write concise, evidence-based explanations describing what you saw or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making with imperfect options

Evidence-based explanations

Education

Bachelor’s degree or higher

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail‑oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, and explain issues in writing from home on your schedule.

Ideal candidates are fluent in English, highly detail‑oriented, and able to make clear decisions when faced with imperfect options. Remote, freelance opportunities with flexible hours.