Remote Audio Evaluation Specialist

Meridial

United States

Remote

USD 15,000 - 42,000

Part time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Aitrainergigs is seeking contractors to design and run role-play–based evaluations of advanced agentic audio models, benchmarking them against real-world customer support use cases across travel, finance, and telecom. You will develop diverse datasets, implement evaluation rubrics, and ensure conversations meet clarity, efficiency, and natural flow.

Ideal candidates have strong verbal English, excellent listening and writing skills, and experience reasoning about structured data (JSON,

Qualifications

  • Create and execute role-play–based evaluation scenarios across multiple domains.
  • Develop diverse and representative datasets used to benchmark agents.
  • Evaluate model performance using a standardized set of qualitative and quantitative metrics.
  • Communicate findings clearly in written and spoken English.
  • Ability to work with JSON structures and simple logic.

Responsibilities

  • Create and execute role-play–based evaluation scenarios across domains.
  • Contribute to diverse and representative datasets used to benchmark agents.
  • Evaluate model performance against qualitative and quantitative metrics.
  • Ensure evaluations reflect real customer expectations for clarity and efficiency.

Skills

Verbal communication
English proficiency
Structured data reasoning
JSON familiarity
Audio evaluation
Remote work discipline

Tools

Audio recording software
Note-taking tools

Job description

Aitrainergigs is seeking contractors to design and run role-play–based evaluations of advanced agentic audio models, benchmarking them against real-world customer support use cases across travel, finance, and telecom. You will develop diverse datasets, implement evaluation rubrics, and ensure conversations meet clarity, efficiency, and natural flow.

Ideal candidates have strong verbal English, excellent listening and writing skills, and experience reasoning about structured data (JSON,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Agentic Audio Evaluation Specialist
Remote Agentic Audio Evaluation Specialist

Meridial • United States

Remote
USD 15,000 - 42,000
Remote Audio Evaluation Architect
Remote Audio Evaluation Architect

Meridial • United States

Remote
USD 8,300 - 90,000
Remote Audio Evaluation Engineer (Contract)
Remote Audio Evaluation Engineer (Contract)

Agency • United States

Remote
USD 15,000 - 42,000
Remote German Audio Evaluation Specialist
Remote German Audio Evaluation Specialist

Meridial • United States

Remote
USD 8,300 - 90,000
Remote Italian Audio Evaluations Expert
Remote Italian Audio Evaluations Expert

Meridial • United States

Remote
USD 8,300 - 90,000
Remote Welsh Audio Evaluation Specialist
Remote Welsh Audio Evaluation Specialist

Meridial • United States

Remote
USD 8,300 - 90,000
High-quality microphone provided
Agentic Audio Evaluation Specialist
Agentic Audio Evaluation Specialist

Agency • United States

Remote
USD 34,000 - 55,000
Dutch Audio Evaluation Specialist (Remote, Freelance)
Dutch Audio Evaluation Specialist (Remote, Freelance)

Meridial • United States

Remote
USD 8,300 - 90,000
Remote French Audio AI Evaluation Specialist
Remote French Audio AI Evaluation Specialist

Meridial • United States

Remote
USD 8,300 - 90,000
Audio Specialist- Freelance AI Trainer Project
Audio Specialist- Freelance AI Trainer Project

Agency • United States

Remote
USD 15,000 - 42,000