Remote AI Media Quality Evaluator

Scale AI; Pickering; Remote; CAD 24,000 - 34,000; Part time

Benefits offered by this job

Flexible scheduling

Weekly payments

Free access to leading LLMs

Global expert community

Job summary

Outlier, owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media on a flexible freelance basis. You will roleplay live conversations with an AI voice model, rate responses, compare media to prompts, and explain your judgments in writing.

Work remotely with a self-paced schedule. Pay starts at up to USD 15 per hour plus incentives; payments are weekly via PayPal or ACH, with opportunities across multiple countries.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to explain observations.
• Experience writing concise explanations or reviews.
• Ability to decide clearly when multiple options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like distortions or misalignments; explain findings in writing.
• Rate outputs across dimensions (adherence, quality, realism) and provide concise explanations.

Skills

Fluent English

Attention to detail

Clear written communication

Evidence-based explanations

Education

Bachelor’s degree or above

Job description

Outlier, owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media on a flexible freelance basis. You will roleplay live conversations with an AI voice model, rate responses, compare media to prompts, and explain your judgments in writing.

Work remotely with a self-paced schedule. Pay starts at up to USD 15 per hour plus incentives; payments are weekly via PayPal or ACH, with opportunities across multiple countries.