Remote AI Voice Conversation Evaluator

Welocalize, Inc.; Toronto; On-site; CAD 47,000 - 55,000; Full time

Job summary

Welocalize, Inc. is seeking detail-focused Audio Raters to evaluate conversations between users and AI voice agents. You will listen to recorded interactions and assess responses on Content and Prosody scales, providing brief rationales for each score.

This freelance, remote role offers roughly 10 hours per week from Canada, starting ASAP. Comfortable communication in English (Canada) and strict attention to quality are essential for consistency across evaluations.

Qualifications

• Strong listening and attention-to-detail skills.
• Ability to give consistent, well-reasoned ratings.
• Clear, concise written communication.
• Reliable availability for ~10 hours/week.

Responsibilities

• Listen carefully to recorded conversations between a person and an AI voice agent
• Rate each of the agent's turns on two independent 1-5 scales
• Write a short, specific, and clear justification for each score given

Skills

Attention to detail

Listening skills

Written communication

Reliability

Consistency

Job description

Welocalize, Inc. is seeking detail-focused Audio Raters to evaluate conversations between users and AI voice agents. You will listen to recorded interactions and assess responses on Content and Prosody scales, providing brief rationales for each score.

This freelance, remote role offers roughly 10 hours per week from Canada, starting ASAP. Comfortable communication in English (Canada) and strict attention to quality are essential for consistency across evaluations.