Remote AI Writing Quality Evaluator & Reviewer

Scale AI; Airdrie; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Free access to leading LLMs

Flexible schedule

Global expert community

Job summary

Outlier, an AI evaluation platform owned by Scale AI, invites detail-oriented English speakers to review AI-generated media remotely and on their own schedule. You will roleplay live conversations with AI voice models, compare AI-generated images and videos to prompts, and explain identified issues in writing.

Ideal candidates are fluent in English, highly attentive to detail, and comfortable delivering concise, evidence-based reviews.

Qualifications

• Fluent English with strong written communication.
• Experience writing short, evidence-based explanations or reviews.
• Excellent attention to detail and the patience to replay or zoom in when something seems off.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos to judge adherence to the prompt.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or audio-video mismatch.
• Writing specific explanations in English detailing what was seen or heard.

Skills

Fluent English

Clear written communication

Attention to detail

Evidence-based writing

Education

Bachelor’s degree or above

Job description

Outlier, an AI evaluation platform owned by Scale AI, invites detail-oriented English speakers to review AI-generated media remotely and on their own schedule. You will roleplay live conversations with AI voice models, compare AI-generated images and videos to prompts, and explain identified issues in writing.

Ideal candidates are fluent in English, highly attentive to detail, and comfortable delivering concise, evidence-based reviews.