Remote AI Response Quality Analyst

Scale AI; Corner Brook; Remote; CAD 17,000 - 29,000; Part time

Benefits offered by this job

Flexible schedule

Free LLM access

Global expert network

Job summary

Scale AI’s Outlier platform seeks detail-oriented English speakers to review AI-generated media, roleplay live conversations with AI voices, and score outputs while explaining findings in writing. You can work remotely on your own schedule, with compensation per hour and frequent incentives.

Applicants from multiple countries may join as contractors. Ideal candidates communicate clearly, show strong attention to detail, and can make clear decisions when options have flaws.

Qualifications

• Fluent English with clear written communication.
• Excellent attention to detail and ability to replay or zoom in to review outputs.
• Comfortable thinking on your feet and discussing realistic scenarios.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs to spot issues like distorted anatomy, flickering, or audio-video mismatches.
• Write concise explanations in English pointing to observed issues.

Skills

Fluent English

Attention to detail

Clear written communication

Fast thinking in conversation

Explanations in writing

Decision-making under flaws

Bachelor’s degree (nice to have)

Education

Bachelor’s degree or above

Job description

Scale AI’s Outlier platform seeks detail-oriented English speakers to review AI-generated media, roleplay live conversations with AI voices, and score outputs while explaining findings in writing. You can work remotely on your own schedule, with compensation per hour and frequent incentives.

Applicants from multiple countries may join as contractors. Ideal candidates communicate clearly, show strong attention to detail, and can make clear decisions when options have flaws.