Remote AI Evaluator — Flexible Hours

Scale AI; Maple Ridge; Remote; CAD 29,000 - 41,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Job summary

Outlier is seeking detail-oriented English speakers to help train AI models through live conversations and evaluation of AI-generated content. You will rank outputs for naturalness and usefulness, compare image/video prompts, and provide concise written explanations in English.

Flexible, remote, freelance project with onboarding screening. The role requires clear communication, strong attention to detail, and the ability to make decisions when options have flaws.

Qualifications

• Fluent English speaker with strong, clear written communication.
• Pursuing or holding a Bachelor’s degree or above.
• Strong attention to detail, with patience to look and listen closely, and replay or zoom in when something seems off.
• Comfortable thinking on your feet and talking through realistic situations in a natural, conversational way.
• Experience writing short, evidence-based explanations or reviews.
• Comfortable making a clear decision when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank how natural, useful, and clear outputs sound.
• Compare pairs of AI-generated images/videos and judge which follows the prompt better.
• Inspect outputs closely to spot distortions, flickering, or misaligned audio/video, using zoom/replay as needed.
• Provide ratings across dimensions (adherence, quality, realism) and write explanations.
• Contribute to onboarding and screening processes as part of project setup.

Skills

Fluent English

Strong written communication

Attention to detail

Decision making

Experience writing explanations

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented English speakers to help train AI models through live conversations and evaluation of AI-generated content. You will rank outputs for naturalness and usefulness, compare image/video prompts, and provide concise written explanations in English.

Flexible, remote, freelance project with onboarding screening. The role requires clear communication, strong attention to detail, and the ability to make decisions when options have flaws.