Remote English Audio Quality Evaluator

Welocalize, Inc.; Auckland; On-site; NZD 46,000 - 61,000; Part time

Job summary

Welocalize, Inc. is seeking detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You will listen to recorded interactions and assess the quality of the AI agent's responses on Content and Prosody, then provide concise justifications for each score.

This freelance, remote role aligns with New Zealand time zones and requires ~10 hours per week. Start ASAP with a pay rate of US$22.1 per hour.

Qualifications

• Strong listening and attention-to-detail skills.
• Ability to give consistent, well-reasoned ratings.
• Clear, concise written communication.
• Reliable availability for ~10 hours/week.

Responsibilities

• Listen to recordings of conversations between a person and an AI voice agent.
• Rate each agent turn on Content and Prosody scales.
• Write a short, specific justification for each score.

Skills

Listening

Attention to detail

Written communication

Consistency in assessment

Job description

Welocalize, Inc. is seeking detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You will listen to recorded interactions and assess the quality of the AI agent's responses on Content and Prosody, then provide concise justifications for each score.

This freelance, remote role aligns with New Zealand time zones and requires ~10 hours per week. Start ASAP with a pay rate of US$22.1 per hour.