Remote AI Evaluation Specialist

Scale AI; West Kelowna; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Job summary

Outlier, a Scale AI platform, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate outputs, and explain issues in writing, all remotely and on your own schedule.

Ideal candidates are fluent in English, detail-focused, and able to explain observations clearly. The role is freelance with no minimum hours and payments are issued weekly in USD.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Comfortable thinking on your feet and discussing realistic situations naturally.
• Experience writing concise, evidence-based explanations or reviews.
• Able to decide clearly when both options have flaws.
• Bachelor’s degree or above preferred.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness and usefulness.
• Comparing AI-generated images and videos and judging which follows the prompt better.
• Inspecting outputs to spot problems like distorted anatomy, flickering, or mismatched audio.
• Writing explanations in English that point to what was observed.

Skills

Fluent English

Attention to detail

Think on your feet

Evidence-based explanations

Clear decision making

Bachelor’s degree (nice to have)

Education

Bachelor’s degree or above

Job description

Outlier, a Scale AI platform, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate outputs, and explain issues in writing, all remotely and on your own schedule.

Ideal candidates are fluent in English, detail-focused, and able to explain observations clearly. The role is freelance with no minimum hours and payments are issued weekly in USD.