AI Content Quality Auditor - Remote & Flexible

Scale AI; Victoria; Remote; CAD 17,000 - 29,000; Full time

Job summary

Outlier, an AI evaluation platform backed by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will conduct live conversations with AI voice models, rank outputs by naturalness and usefulness, and write concise explanations of observed issues, remotely and on your own schedule.

Ideal candidates are fluent in English, highly attentive to detail, and capable of clear written communication.

Qualifications

• Fluent English with clear written communication.
• Detail-oriented with ability to review AI outputs.
• Experience writing concise, evidence-based explanations or reviews.
• Confident decision-maker when options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely and note issues like artifacts, flickering, or audio-video misalignment.
• Provide written explanations pointing to observed issues and reasoning.

Skills

Fluent English

Attention to detail

Written communication

Independent working

Education

Bachelor’s degree or above

Job description

Outlier, an AI evaluation platform backed by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will conduct live conversations with AI voice models, rank outputs by naturalness and usefulness, and write concise explanations of observed issues, remotely and on your own schedule.

Ideal candidates are fluent in English, highly attentive to detail, and capable of clear written communication.