Remote AI Evaluation Specialist

Scale AI; Charlottetown; Remote; CAD 17,000 - 29,000; Full time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global community of experts

Job summary

Outlier is an AI training platform owned by Scale AI. We are seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges remotely on your own schedule.

Contributors review images, videos, and audio, provide written explanations of issues, and help improve model performance. This is a freelance, 1099 contract opportunity with weekly payments and potential incentives.

Qualifications

• Fluent English speaker with clear written communication.
• Strong attention to detail and ability to replay or zoom in when something seems off.
• Able to think on your feet and discuss realistic scenarios naturally.
• Experience writing concise, evidence-based explanations or reviews.
• Able to make a clear decision when options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge adherence to prompts.
• Inspect outputs closely to spot issues like distortions, flickering, or misalignment.
• Write explanations in English pointing to what was observed and heard.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making under ambiguity

Explaining assessments clearly

Education

Bachelor’s degree or above

Job description

Outlier is an AI training platform owned by Scale AI. We are seeking detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges remotely on your own schedule.

Contributors review images, videos, and audio, provide written explanations of issues, and help improve model performance. This is a freelance, 1099 contract opportunity with weekly payments and potential incentives.