Remote AI Evaluation Specialist

Scale AI; Mississauga; Remote; CAD 17,000 - 29,000; Part time

Benefits offered by this job

Flexible schedule

Remote work possible

Free access to leading LLMs

Job summary

Outlier is seeking detail-oriented English speakers to review AI-generated media and roleplay live conversations with an AI voice model. You will score exchanges, compare AI-generated visuals, and explain in writing what looked or sounded off, all remotely on your own schedule.

Your work helps shape how advanced AI systems reason and improve. Ideal candidates are fluent in English, highly attentive to detail, and capable of clear, evidence-based explanations.

Qualifications

• Fluent English with strong written communication.
• Excellent attention to detail and patience to review outputs.
• Comfortable thinking on your feet and explaining decisions clearly.
• Experience writing concise, evidence-based explanations or reviews.

Responsibilities

• Hold live, scenario-based conversations in English with AI voice models and rate naturalness, usefulness, and clarity.
• Compare AI-generated images/videos and judge adherence to prompts.
• Inspect outputs closely (zoom/replay) to spot errors in anatomy, motion, text, or audio alignment.
• Provide written explanations pointing to observed issues and assessment rationale.

Skills

Fluent English

Attention to detail

Clear written communication

Decision making

Bachelor’s degree

Education

Bachelor’s degree

Job description

Outlier is seeking detail-oriented English speakers to review AI-generated media and roleplay live conversations with an AI voice model. You will score exchanges, compare AI-generated visuals, and explain in writing what looked or sounded off, all remotely on your own schedule.

Your work helps shape how advanced AI systems reason and improve. Ideal candidates are fluent in English, highly attentive to detail, and capable of clear, evidence-based explanations.