Remote AI Content Evaluator & Quality Reviewer

Scale AI; Vancouver; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Free LLM access

Flexible schedule

Global community of experts

Job summary

Outlier, owned by Scale AI, is seeking detail-oriented English speakers to review AI-generated media for diversity of tasks including image, video, and audio evaluations. You will roleplay with an AI voice model, rank naturalness, and provide written explanations for evaluation choices.

This freelance role offers flexible scheduling and global eligibility, with weekly payments. Applicants should have strong written English and a keen eye for detail across multimedia content.

Qualifications

• Fluent English with clear written communication.
• Strong attention to detail and patience to replay or zoom in.
• Comfortable thinking on your feet and speaking through realistic situations.
• Experience writing concise, evidence-based explanations or reviews.
• Nice to have: Bachelor's degree or above.

Responsibilities

• Hold a live, scenario-based conversation in English with AI voice models, then rank how natural, useful, and clear each one sounded.
• Compare pairs of AI-generated images and videos and judge which one better follows the prompt.
• Inspect outputs closely, including zooming in and replaying, to spot problems like distorted anatomy, flickering or unnatural motion, text errors, and audio mismatch.
• Rate each output across dimensions such as adherence, quality, and realism, then write a specific English explanation of what you saw or heard.

Skills

Fluent English

Attention to detail

Quick thinking

Evidence-based writing

Bachelor’s degree

Education

Bachelor’s degree or above

Job description

Outlier, owned by Scale AI, is seeking detail-oriented English speakers to review AI-generated media for diversity of tasks including image, video, and audio evaluations. You will roleplay with an AI voice model, rank naturalness, and provide written explanations for evaluation choices.

This freelance role offers flexible scheduling and global eligibility, with weekly payments. Applicants should have strong written English and a keen eye for detail across multimedia content.