Remote AI Media Quality Evaluator

Scale AI; City of Moncton; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Free LLM access

Global community

Pre-release models access

Job summary

Outlier, a Scale AI company, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare image/video pairs, and write explicit explanations of what looked or sounded off.

Work remotely with flexible hours, earning up to USD 15 per hour plus additional incentives. Applicants from multiple countries, including Canada, can apply. Presence of a valid ID and resume are required to start tasks.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Able to think on your feet and articulate realistic scenarios clearly.
• Experience writing short, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot distortions, flickering, incorrect audio, or artifacts; explain findings in writing.

Skills

Fluent English

Attention to detail

Written communication

Decision making under flaws

Bachelor’s degree (nice to have)

Education

Bachelor’s degree or above

Job description

Outlier, a Scale AI company, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score exchanges, compare image/video pairs, and write explicit explanations of what looked or sounded off.

Work remotely with flexible hours, earning up to USD 15 per hour plus additional incentives. Applicants from multiple countries, including Canada, can apply. Presence of a valid ID and resume are required to start tasks.