Remote AI Audio Evaluation Specialist

Meridial; United States; Remote; USD 15,153 - 42,223; Part time

Job summary

Meridial is seeking an Audio Specialist for a freelance AI Trainer project to evaluate and benchmark audio models for customer support. The role will involve creating realistic evaluation scenarios across various domains, contributing to dataset development, and assessing model performance.

Candidates must possess fluency in English and basic programming knowledge, alongside the ability to work remotely with necessary audio equipment. The pay range is $11 to $30.65 per hour based on experience and location.

Qualifications

• Fluency in English across reading, listening, writing, and speaking.
• Proficient access to high-quality microphone for audio input.
• Ability to work with structured prompts and technical guidelines.

Responsibilities

• Create role-play based evaluation scenarios simulating customer interactions.
• Contribute to diverse datasets for assessing audio agents.
• Evaluate model performance using qualitative and quantitative metrics.
• Ensure evaluations reflect customer expectations.

Skills

Task completion accuracy

Conversational naturalness

Audio comprehension

Instruction adherence

Basic computer programming literacy

Technical communication clarity

Job description

Audio Specialist- Freelance AI Trainer Project

World Wide - Remote

A project dedicated to assessing and benchmarking advanced agentic audio models against leading systems. The program’s mission is to evaluate and optimize model performance for real-world customer support use cases.
Responsibilities

• Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including:
  • Flight bookings and travel support
  • Financial services
  • Telecommunications and technical support
• Contribute to the development of diverse and representative datasets used to assess conversational audio agents.
• Evaluate model performance across a standardized set of qualitative and quantitative metrics.
• Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow.

Evaluation Metrics
Model performance is assessed using a combination of conversational, technical, and audio-specific criteria, including but not limited to:

• Task completion accuracy and efficiency
• Conversational naturalness (tone, flow, and coherence)
• Audio comprehension and response quality
• Instruction adherence and contextual understanding
• Basic computer programming literacy, including:
  • Understanding of JSON structures
  • Familiarity with functions and methods
  • Ability to reason about structured data and simple logic
• Technical communication clarity when handling support-style problem-solving

Technical & Equipment Requirements

• English proficiency including fluency across all language skills: reading, listening, writing, and speaking.
• Access to a high-quality microphone to ensure clean, reliable audio input during evaluations
• Comfort working with structured prompts, evaluation rubrics, and technical guidelines
• Device capable of running audio recording software and opening large technical documentation

We offer a pay range of $11-to-$30.65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.

Employment type: Contract
Workplace type: Remote
Seniority level: Mid‑Senior Level

Apply for this job

*

indicates a required field

First Name *

Last Name *

Email *

Phone

Country *

Phone *

Location (City) *

Resume/CV *

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Education

School Select...

Degree * Select...

Select...

Start date year *

End date year *

What country are you currently a resident of? * Select...

If you are currently based in United States, please confirm your current state of residence. If you are based outside of the United States, select "I am not located in the United States". * Select...

LinkedIn Profile *

Please acknowledge that you have read and agree to our Privacy Policy. *

Yes

By clicking "Submit Application", you agree to Invisible's Privacy Policy .