Remote AI Content Evaluator & Quality Reviewer

Scale AI; Milton; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Join 900K+ Outlier Experts

Collaborate with experts

Job summary

Outlier, the AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models and score exchanges, comparing image and video outputs to judge which follows the prompt better.

You’ll explain in writing what looked or sounded wrong, all remotely and on your own schedule. Ideal candidates are fluent in English, can notice subtle errors, and can articulate their reasoning clearly.

Qualifications

• Excellent written English with clear communication.
• Strong attention to detail and careful listening.
• Ability to articulate reasoning for evaluation decisions.
• Willingness to learn and adapt to varied tasks.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness and usefulness.
• Compare AI-generated images/videos and determine which follows prompts better.
• Inspect outputs closely for distortions, glitches, or misalignment and note issues.
• Provide written explanations in English detailing observations and judgments.

Skills

Fluent English

Attention to detail

Quick thinking

Decision making

Clear writing

Education

Bachelor's degree or above

Job description

Outlier, the AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models and score exchanges, comparing image and video outputs to judge which follows the prompt better.

You’ll explain in writing what looked or sounded wrong, all remotely and on your own schedule. Ideal candidates are fluent in English, can notice subtle errors, and can articulate their reasoning clearly.