Remote AI Media Quality Evaluator

Scale AI; Ajax; Remote; CAD 24,000 - 34,000; Part time

Benefits offered by this job

Flexible schedule

Weekly payments

Job summary

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges for naturalness, usefulness, and clarity.

You will compare AI-generated images, videos, and audio to prompts, explain in writing what looked off, and contribute across tasks from image evaluation to caption labeling. Remote, freelancer, flexible schedule.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and ability to replay or zoom in to assess content.
• Able to make clear decisions when options have flaws and justify them in writing.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images/videos and judge which follows prompts better.
• Inspect outputs closely to spot issues like misalignment, artifacts, or audio mismatches.
• Provide written explanations of the observed issues and scoring across dimensions such as adherence and realism.

Skills

Fluent English

Attention to detail

Decisive thinking

Experience documenting explanations

Education

Bachelor’s degree or higher

Job description

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges for naturalness, usefulness, and clarity.

You will compare AI-generated images, videos, and audio to prompts, explain in writing what looked off, and contribute across tasks from image evaluation to caption labeling. Remote, freelancer, flexible schedule.