Remote AI Evaluator - English Feedback Specialist

Scale AI; Sydney; Remote; CAD 27,000 - 42,000; Part time

Job summary

Outlier is seeking detail-oriented, fluent English speakers to help train AI models by providing real-time feedback and evaluations. This freelance, remote role offers flexible hours and requires you to assess spoken and visual outputs for naturalness and accuracy.

You will participate in live conversations, compare AI outputs, and write concise, evidence-based explanations in English. A Bachelor’s degree or higher is preferred, with strong attention to detail and clear written communication.

Qualifications

• Fluent English speaker with strong written communication.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rank naturalness, usefulness and clarity.
• Compare AI-generated images and videos and judge how well they follow prompts.
• Inspect outputs by zooming/replaying to spot issues like distorted motion or text errors.
• Provide specific English explanations pointing to what you saw or heard.

Skills

English fluency

Clear written communication

Attention to detail

Conversational speaking

Evidence-based explanations

Education

Bachelor’s degree or above

Job description

Outlier is seeking detail-oriented, fluent English speakers to help train AI models by providing real-time feedback and evaluations. This freelance, remote role offers flexible hours and requires you to assess spoken and visual outputs for naturalness and accuracy.

You will participate in live conversations, compare AI outputs, and write concise, evidence-based explanations in English. A Bachelor’s degree or higher is preferred, with strong attention to detail and clear written communication.