AI Voice Dialogue Rater – Content & Prosody (Remote UK)

Annotation Academy; United States; Remote; USD 28,000 - 36,000; Part time

Job summary

Welo Data is seeking detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You will listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

This freelance position offers about 10 hours per week with a remote setup. Work starts ASAP and pays $23 per hour. You will provide concise justifications for each score and maintain consistent, well-reasoned evaluations.

Qualifications

• Strong listening and attention-to-detail skills.
• Ability to give consistent, well‑reasoned ratings.
• Clear, concise written communication.
• Reliable availability for ~10 hours/week.

Responsibilities

• Listen to recorded conversations between a person and an AI voice agent.
• Rate each turn on Content and Prosody scales.
• Provide short, specific justification for each score.
• Maintain reliable availability for ~10 hours/week.

Skills

Active listening

Attention to detail

Written communication

Consistency in ratings

Job description

Welo Data is seeking detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You will listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

This freelance position offers about 10 hours per week with a remote setup. Work starts ASAP and pays $23 per hour. You will provide concise justifications for each score and maintain consistent, well-reasoned evaluations.