AI Content Integrity Evaluator - Remote, Flexible Hours

Scale AI; Port Coquitlam; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Remote work

LLM access

Global community

Job summary

Outlier, an AI training platform owned and operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded wrong, remotely and on your own schedule.

Responsibilities include evaluating images, videos, captions, and audio, rating across adherence, quality, and realism, and writing concise explanations in English.

Qualifications

• Fluent English and strong written communication are required.
• High attention to detail and the ability to explain observations clearly.
• Comfort with thinking on your feet and describing scenarios.
• Experience writing concise, evidence-based reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like distortion, flicker, audio-video mismatch.
• Write explanations in English detailing what you saw or heard.

Skills

Fluent English

Attention to detail

Clear written communication

Strong verbal skills

Bachelor's degree or above

Education

Bachelor's degree or above

Job description

Outlier, an AI training platform owned and operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model, score exchanges, and explain in writing what looked or sounded wrong, remotely and on your own schedule.

Responsibilities include evaluating images, videos, captions, and audio, rating across adherence, quality, and realism, and writing concise explanations in English.