Remote AI Quality Evaluator – English

Scale AI; Sherbrooke; Remote; CAD 24,000 - 34,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Job summary

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media and roleplay live conversations with AI voice models. You will score exchanges, compare images and videos, and explain issues in writing, all remotely and on your own schedule.

The role emphasizes careful inspection of outputs, adherence to prompts, and clear written rationale, with a focus on contributing to AI model evaluation.

Qualifications

• Fluent English with strong written communication.
• Attention to detail and ability to explain observations clearly.
• Comfortable thinking on your feet and discussing realistic scenarios.

Responsibilities

• Hold live English conversations with AI voice models and rank naturalness and usefulness.
• Compare AI-generated images and videos to judge prompt adherence.
• Inspect outputs for problems like distorted anatomy, flickering, text/audio mismatches.
• Provide written explanations of what you saw or heard.

Skills

Fluent English

Clear written communication

Attention to detail

Able to explain decisions clearly

Decision making

Education

Bachelor's degree or above (nice to have)

Job description

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media and roleplay live conversations with AI voice models. You will score exchanges, compare images and videos, and explain issues in writing, all remotely and on your own schedule.

The role emphasizes careful inspection of outputs, adherence to prompts, and clear written rationale, with a focus on contributing to AI model evaluation.