Remote AI Response & Media Quality Evaluator

Scale AI; Nanaimo; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Job summary

Scale AI, via Outlier, is seeking detail-oriented English speakers to review AI-generated media by engaging in live conversations with an AI voice model and scoring exchanges. You will compare AI-generated images and videos to assess fidelity to prompts and explain what looked or sounded off, remotely and on your own schedule.

Ideal candidates are fluent in English with strong writing, exceptional attention to detail, and comfortable making clear decisions when options have flaws.

Qualifications

• Fluent English with clear written communication.
• Experience writing short, evidence-based explanations or reviews.
• Strong attention to detail and careful evaluation of outputs.
• Ability to decide clearly when both options have flaws.
• Nice to have: Bachelor’s degree or above.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images/videos and judge which follows the prompt better.
• Inspect outputs closely to spot problems like distorted anatomy, flickering, or text/audio mismatch.
• Write a concise, English explanation pointing to observed issues and adherence to prompts.

Skills

Fluent English

Strong written communication

Attention to detail

Clear decision making

Evidence-based writing

Education

Bachelor’s degree or above

Job description

Scale AI, via Outlier, is seeking detail-oriented English speakers to review AI-generated media by engaging in live conversations with an AI voice model and scoring exchanges. You will compare AI-generated images and videos to assess fidelity to prompts and explain what looked or sounded off, remotely and on your own schedule.

Ideal candidates are fluent in English with strong writing, exceptional attention to detail, and comfortable making clear decisions when options have flaws.