A complete application in a minute
Tailored resume and cover letter, ready to send.
AI Trainer HQ is seeking independent Audio Evaluation Specialists for a remote, freelance contract to support an AI benchmark project. You will design real-world, role-played customer support scenarios and audit AI outputs using structured rubrics, with focus on accuracy, natural dialogue, and audio clarity.
Requirements include native English and/or German proficiency, basic programming literacy (JSON, simple logic), and access to a good microphone.
We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio models. As AI models increasingly handle complex workflows in this domain—specifically real-world customer support scenarios like flight bookings, financial services, and telecommunications—their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks through simulated interactions, audit conversational AI outputs, and generate clean, reliable datasets to optimize model performance.
Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:
To successfully fulfill the deliverables of this project, Contractors must possess deep industry knowledge to craft realistic professional scenarios. Core skillset includes:
Required Equipment: Access to a high-quality microphone to ensure clean, reliable audio input during voice evaluations.
We offer a pay range of $6-to-$65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.
Engagement Type: Freelance / Independent Contractor
Workplace Type: Remote
This job is 100% remote.
Open worldwide.