AI Response Evaluator - Remote & Flexible Hours

Scale AI; Oakville; Remote; CAD 29,000 - 41,000; Part time

Job summary

Outlier is seeking English-speaking freelancers to help train AI models by rating live conversations, images, and videos. This remote, flexible role involves detailed evaluation of model outputs and providing written explanations in English.

Candidates should have a Bachelor’s degree or higher, excellent attention to detail, and comfort with conversational English. Training and onboarding are provided to start, with competitive project-based compensation.

Qualifications

• Fluent English with strong, clear written communication.
• Pursuing or holding a Bachelor’s degree or above.
• Very high attention to detail and patience to replay or zoom in when something seems off.
• Comfortable thinking on your feet and describing realistic situations in conversation.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness, and clarity.
• Compare AI-generated images and videos and judge alignment with prompts.
• Inspect outputs closely to spot issues like distorted motion, text errors, and audio-video mismatches.
• Provide concise, evidence-based written explanations in English outlining observations.

Skills

Fluent English

Strong written communication

Attention to detail

Conversational English

Education

Bachelor’s degree or above

Job description

Outlier is seeking English-speaking freelancers to help train AI models by rating live conversations, images, and videos. This remote, flexible role involves detailed evaluation of model outputs and providing written explanations in English.

Candidates should have a Bachelor’s degree or higher, excellent attention to detail, and comfort with conversational English. Training and onboarding are provided to start, with competitive project-based compensation.