AI Response Evaluator — Remote, Flexible Hours

Scale AI; Longueuil; Remote; CAD 21,000 - 35,000; Part time

Benefits offered by this job

Remote freelance work

Flexible hours

Job summary

Outlier is seeking freelance evaluators to help train AI models. You will conduct live English conversations with AI voice models, rate naturalness and clarity, and provide concise, evidence-based explanations.

You will also compare AI-generated images and videos and assess alignment with prompts, then document findings with precise notes. Remote, flexible hours, and screening onboarding are part of the process.

Qualifications

• Fluent English with strong written communication.
• Pursuing or holding a Bachelor’s degree or above.
• Strong attention to detail and patience to replay or zoom in when something seems off.
• Comfortable thinking on your feet and discussing realistic situations.
• Experience writing short, evidence-based explanations or reviews.
• Able to make clear decisions when both options have flaws.

Responsibilities

• Holding live, scenario-based conversations in English with AI voice models and ranking naturalness, usefulness, and clarity.
• Comparing AI-generated images and videos and judging adherence to the prompt.
• Inspecting outputs closely, including zooming and replaying, to spot problems (e.g., distorted anatomy, flickering, misaligned audio).
• Rating outputs across dimensions like adherence, quality, and realism, with a written explanation in English.

Skills

Fluent English

Attention to detail

Clear written communication

Think on your feet

Evidence-based explanations

Decision making under ambiguity

Education

Bachelor’s degree or above

Job description

Outlier is seeking freelance evaluators to help train AI models. You will conduct live English conversations with AI voice models, rate naturalness and clarity, and provide concise, evidence-based explanations.

You will also compare AI-generated images and videos and assess alignment with prompts, then document findings with precise notes. Remote, flexible hours, and screening onboarding are part of the process.