Remote AI Writing Evaluator & Feedback Specialist

Scale AI; North Vancouver; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

1099 freelance contract

Weekly payments

Job summary

Outlier, an AI training platform backed by Scale AI, seeks detail-oriented English speakers to review AI-generated media and roleplay live conversations with AI voice models. You will score outputs, compare prompts to results, and explain observations in writing from anywhere with flexible hours.

Responsibilities include evaluating images, videos, and audio against prompts, and providing concise, evidence-based explanations. This is a freelance, contract role with weekly payments.

Qualifications

• Fluent English with clear written communication.
• Attention to detail and ability to review media carefully.
• Ability to explain decisions in writing.
• Comfortable working independently.
• Optional: pursuing/holding a Bachelor’s degree.

Responsibilities

• Holding a live, scenario-based conversation in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging adherence to prompts.
• Inspecting outputs closely to spot issues like distorted anatomy, flickering, or misaligned audio.
• Writing a clear, evidence-based explanation of observations in English.

Skills

Fluent English

Attention to detail

Written communication

Decision making

Critical thinking

Bachelor's degree (preferred)

Education

Bachelor’s degree (preferred)

Job description

Outlier, an AI training platform backed by Scale AI, seeks detail-oriented English speakers to review AI-generated media and roleplay live conversations with AI voice models. You will score outputs, compare prompts to results, and explain observations in writing from anywhere with flexible hours.

Responsibilities include evaluating images, videos, and audio against prompts, and providing concise, evidence-based explanations. This is a freelance, contract role with weekly payments.