Remote AI Content Evaluator — Fluent English Feedback

Scale AI; San Juan de Terranova; Remote; CAD 29,000 - 41,000; Full time

Job summary

Outlier is seeking detail-oriented, fluent English speakers to train AI models through live conversations and structured evaluations. You will rate naturalness and clarity in real-time, compare AI-generated visuals, and provide concise, evidence-based explanations for your judgments.

The role is remote and flexible, ideal for independent contributors who value precision, clear communication, and rigorous attention to detail in a fast-moving AI workflow.

Qualifications

• Fluent English with strong written communication.
• Pursuing or holding a Bachelor’s degree or above.
• Strong attention to detail with patience to replay/zoom in when something seems off.
• Comfortable thinking on your feet and explaining scenarios in conversation.
• Experience writing short, evidence-based explanations or reviews.
• Able to make a clear decision when both options have flaws.

Responsibilities

• Hold live, scenario-based conversations in English with AI models and rate naturalness, usefulness, and clarity.
• Compare pairs of AI-generated images or videos and judge adherence to prompts.
• Inspect outputs closely (zoom, replay) to spot issues like distorted motion, text errors, or audio-video mismatch.
• Provide written explanations detailing what you observed for each evaluation.

Skills

Fluent English

Clear written communication

Attention to detail

On-the-spot thinking

Evidence-based explanations

Decision making under ambiguity

Education

Bachelor’s degree or higher

Job description

Outlier is seeking detail-oriented, fluent English speakers to train AI models through live conversations and structured evaluations. You will rate naturalness and clarity in real-time, compare AI-generated visuals, and provide concise, evidence-based explanations for your judgments.

The role is remote and flexible, ideal for independent contributors who value precision, clear communication, and rigorous attention to detail in a fast-moving AI workflow.