Remote AI Media Evaluator: Images, Video & Speech

Scale AI; City of Miramichi; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert community

Job summary

Scale AI operates Outlier, an AI training platform where Experts review AI-generated media, rate performance, and write concise explanations. You’ll roleplay live conversations, compare outputs, and assess alignment with prompts, all on your own schedule and remotely.

Ideal candidates are fluent English speakers with keen attention to detail, capable of clear, evidence-based writing. You’ll provide objective feedback and determine the best option when multiple outputs have flaws.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Excellent attention to detail and patience to review outputs closely.
• Ability to think on your feet and discuss realistic scenarios in natural dialogue.
• Experience writing short, evidence-based explanations or reviews.
• Ability to make clear decisions when faced with flawed options.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which follows prompts better.
• Inspect outputs closely to spot issues like distorted anatomy, flickering, text errors, or audio-video mismatches.
• Provide written explanations of findings in English, highlighting what was observed.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based writing

Decisive decision making

Education

Bachelor’s degree or above

Job description

Scale AI operates Outlier, an AI training platform where Experts review AI-generated media, rate performance, and write concise explanations. You’ll roleplay live conversations, compare outputs, and assess alignment with prompts, all on your own schedule and remotely.

Ideal candidates are fluent English speakers with keen attention to detail, capable of clear, evidence-based writing. You’ll provide objective feedback and determine the best option when multiple outputs have flaws.