Remote AI Media Evaluator & Conversation Reviewer

Scale AI; Saint-Georges; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert community

Job summary

Outlier, an AI training platform owned by Scale AI, seeks English-speaking evaluators to rate and explain AI outputs across images, videos, audio, and captions. You’ll work remotely with a flexible schedule and review AI-generated media to help improve model performance.

Contributors work independently, earning hourly pay with performance incentives and weekly payments. Applicants from multiple countries can participate in a freelance contractor role.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and ability to zoom in on audio/video cues.
• Comfortable speaking in natural, unscripted conversations.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations with AI voice models in English and assess naturalness and usefulness.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like distortions, flickering, or misalignment, and explain findings in writing.
• Provide clear decisions when options have flaws and write a specific, concise rationale.

Skills

Fluent English

Attention to detail

Conversational speaking

Evidence-based writing

Decision making

Bachelor’s degree

Education

Bachelor’s degree or above

Job description

Outlier, an AI training platform owned by Scale AI, seeks English-speaking evaluators to rate and explain AI outputs across images, videos, audio, and captions. You’ll work remotely with a flexible schedule and review AI-generated media to help improve model performance.

Contributors work independently, earning hourly pay with performance incentives and weekly payments. Applicants from multiple countries can participate in a freelance contractor role.