Remote Audio Rater: AI Conversation Evaluator

Welo Global; United Kingdom; Remote; GBP 20,000 - 28,000; Part time

Job summary

Welo Global is seeking detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You will listen to recorded interactions and rate the agent turns on Content and Prosody on a 1–5 scale, plus write concise justifications. This is a freelance, remote role based in the United Kingdom, requiring British English.

Start date is ASAP, with about 10 hours per week. Pay rate is $23 per hour, reflecting part-time freelance engagement and flexible scheduling.

Qualifications

• Strong listening and attention-to-detail skills.
• Ability to give consistent, well-reasoned ratings.
• Clear, concise written communication.

Responsibilities

• Listen carefully to recorded conversations between a person and an AI voice agent.
• Rate each agent turn on Content and Prosody scales (1–5).
• Write a short, specific justification for each score.

Skills

Active listening

Attention to detail

Written communication

Reliability

Job description

Welo Global is seeking detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You will listen to recorded interactions and rate the agent turns on Content and Prosody on a 1–5 scale, plus write concise justifications. This is a freelance, remote role based in the United Kingdom, requiring British English.

Start date is ASAP, with about 10 hours per week. Pay rate is $23 per hour, reflecting part-time freelance engagement and flexible scheduling.