Remote AI Evaluation Specialist — Flexible Freelance

Scale AI; Kelowna; Hybrid; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Freelance contractor

Weekly payments

Free access to leading LLMs

Job summary

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score each exchange remotely on your own schedule.

You will compare AI-generated images, videos, and audio, explain in writing what looked wrong, and rate outputs for adherence, quality, and realism. This is a 1099 freelance opportunity with weekly payments.

Qualifications

• Fluent English with strong written communication.
• Ability to think on your feet and explain decisions clearly.
• Experience writing brief, evidence-based reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot distortions, flicker, or misalignment and explain findings in writing.
• Rate outputs across dimensions like adherence, quality, and realism.

Skills

Fluent English

Attention to detail

Verbal reasoning

Clear explanations

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score each exchange remotely on your own schedule.

You will compare AI-generated images, videos, and audio, explain in writing what looked wrong, and rate outputs for adherence, quality, and realism. This is a 1099 freelance opportunity with weekly payments.