Audio Quality Assessor for Voice AI (Remote, Part‑Time)

Annotation Academy

United States

Remote

USD 9,200 - 15,000

Part time

10 days ago
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Welo Data is seeking detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You will listen to recordings and score each agent turn on Content and Prosody on a 1-5 scale.

This freelance, remote role offers about 10 hours per week with a pay rate of $26.00 per hour. Ideal candidates have sharp listening skills and clear written communication, with a reliable schedule for ongoing collaboration.

Qualifications

  • Strong listening and attention-to-detail skills.
  • Ability to give consistent, well-reasoned ratings.
  • Clear, concise written communication.
  • Reliable availability for ~10 hours/week.

Responsibilities

  • Listen carefully to recorded conversations between a person and an AI voice agent.
  • Rate each agent turn on Content and Prosody using a 1-5 scale.
  • Write a short, specific justification for each score.

Skills

Active listening
Attention to detail
Written communication
Reliability

Job description

Welo Data is seeking detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You will listen to recordings and score each agent turn on Content and Prosody on a 1-5 scale.

This freelance, remote role offers about 10 hours per week with a pay rate of $26.00 per hour. Ideal candidates have sharp listening skills and clear written communication, with a reliable schedule for ongoing collaboration.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Audio Rater for AI Conversations (Freelance, Part-Time)
Remote Audio Rater for AI Conversations (Freelance, Part-Time)

Welo Global • Northern (KY)

Hybrid
USD 30,000 - 42,000
Remote Audio Quality Evaluator for AI Chats
Remote Audio Quality Evaluator for AI Chats

Annotation Academy • United States

Remote
USD 30,000 - 36,000
AI Voice Dialogue Rater – Content & Prosody (Remote UK)
AI Voice Dialogue Rater – Content & Prosody (Remote UK)

Annotation Academy • United States

Remote
USD 28,000 - 36,000
Remote Audio Rater for AI Conversations
Remote Audio Rater for AI Conversations

Welocalize, Inc. • Town of Texas (WI)

On-site
USD 30,000 - 41,000
English Audio Rater: Part-Time Freelance Evaluator
English Audio Rater: Part-Time Freelance Evaluator

Welo Data • United States

Remote
USD 28,000 - 41,000
Remote Audio Rater & Feedback Specialist (Freelance)
Remote Audio Rater & Feedback Specialist (Freelance)

Welo Data • United States

Remote
USD 34,000 - 44,000
English (United States) Audio Rater
English (United States) Audio Rater

Welocalize, Inc. • Town of Texas (WI)

On-site
USD 30,000 - 41,000
Audio Rater - Generalist - English (Canada) (Fully Remote)
Audio Rater - Generalist - English (Canada) (Fully Remote)

Welo Data • United States

Remote
USD 28,000 - 41,000
Audio Quality Rater - Content & Prosody (Remote)
Audio Quality Rater - Content & Prosody (Remote)

Annotation Academy • United States

Remote
USD 37,000 - 41,000
Andromeda Sadiradra - Audio Rater - Generalist - English (United State)
Andromeda Sadiradra - Audio Rater - Generalist - English (United State)

Welo Global • Northern (KY)

Hybrid
USD 30,000 - 42,000