English Audio Rater

Welocalize, Inc.; Auckland; Remote; NZD 54,000 - 61,000; Full time

Job summary

Welocalize, Inc. seeks detail-oriented Audio Raters to assess conversations between users and AI voice agents. You will listen to recordings, rate each agent turn on content and prosody scales, and provide concise justifications.

This freelance, remote role in New Zealand requires strong listening, consistent scoring, and clear written communication, with an expected ~10 hours per week.

Qualifications

• Strong listening and attention-to-detail skills.
• Ability to give consistent, well-reasoned ratings.
• Clear, concise written communication.
• Reliable availability for ~10 hours/week.

Responsibilities

• Listen carefully to recorded conversations between a person and an AI voice agent.
• Rate each of the agent's turns on two 1–5 scales: Content and Prosody.
• Write a short, specific justification for each score given.

Skills

Listening

Attention to detail

Written communication

Reliability

Job description

Overview:

We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

Project Details:

Start Date: ASAP

Duration: 10 hours/week

Job Type: Freelance

Location: Remote (New Zealand)

Language: English(New Zealand)

Pay Rate: US$22.1/hour

What You'll do:

• Listen carefully to recorded conversations between a person and an AI voice agent
• Rate each of the agent's turns on two independent 1–5 scales:
• Content– Was the response helpful, relevant, and appropriate?
• Prosody– Did the voice sound natural, well-paced, and expressive?
• Write a short, specific, and clear justification for each score given

What We're Looking For:

• Strong listening and attention-to-detail skills
• Ability to give consistent, well-reasoned ratings
• Clear, concise written communication
• Reliable availability for ~10 hours/week

Thank you for your interest in joining Welo Data's community and contributing to this exciting project. We look forward to collaborating with you!