Remote AI Quality Evaluator & Feedback Specialist

Scale AI; San Juan de Terranova; Remote; CAD 17,000 - 29,000; Part time

Benefits offered by this job

Flexible schedule

Free access to leading LLMs

Global expert network

Collaborate with experts

Job summary

Outlier is an AI training platform owned and operated by Scale AI. We seek detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges, all remotely and on your own schedule.

You will write concise explanations, compare images, videos, and audio, and help improve how AI systems reason and perform. This freelance, 1099 contract opportunity offers flexible hours and weekly payments.

Qualifications

• Fluent English with clear, written communication.
• Excellent attention to detail and the patience to replay or zoom in when something seems off.
• Comfortable thinking on your feet and articulating decisions clearly in conversation.
• Nice to have a Bachelor’s degree or above.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge which better follows the prompt.
• Inspect outputs closely to spot problems like distorted anatomy, flicker, or audio-visual misalignment; write explanations in English.
• Provide concise, evidence-based explanations pointing to observed issues and improvements.

Skills

Fluent English

Attention to detail

Oral/written reasoning

Evidence-based explanations

Education

Bachelor’s degree or above

Job description

Outlier is an AI training platform owned and operated by Scale AI. We seek detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges, all remotely and on your own schedule.

You will write concise explanations, compare images, videos, and audio, and help improve how AI systems reason and perform. This freelance, 1099 contract opportunity offers flexible hours and weekly payments.