German Audio Evaluations Specialist

Meridial

United States

Remote

USD 8,300 - 90,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Aitrainergigs is seeking independent Audio Evaluation Specialists for an AI benchmark project that tests agentic audio models in real-world customer support scenarios across travel, finance, and telecom. The role is remote and freelance, with a strong emphasis on data quality and rigorous evaluation.

As a contractor, you will design and execute role-play evaluations, audit AI outputs, assess JSON-related reasoning, and help generate diverse, high-quality audio datasets.

Qualifications

  • Demonstrated expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
  • Native or bilingual English with strong reading, listening, writing and speaking skills.
  • Basic JSON literacy and ability to reason about structured data.
  • Meticulous, detail-oriented approach to prompts, rubrics and guidelines.
  • Must have access to a high-quality microphone for voice evaluations.

Responsibilities

  • Design and execute complex role-play evaluation scenarios across travel, finance, and telecom domains.
  • Audit AI model outputs using standardized qualitative and quantitative metrics.
  • Evaluate model understanding of JSON structures, functions and data reasoning within support context.
  • Contribute to diverse audio dataset generation reflecting real customer expectations.

Skills

Customer support expertise
English proficiency
JSON literacy
Attention to detail
Verbal communication

Job description

Project Overview

We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio models. As AI models increasingly handle complex workflows in this domain—specifically real-world customer support scenarios like flight bookings, financial services, and telecommunications—their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks through simulated interactions, audit conversational AI outputs, and generate clean, reliable datasets to optimize model performance.

Project Deliverables & Scope

Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:

  • Role-Play Scenario Execution: Creating and executing complex, role-play-based evaluation scenarios that simulate realistic customer service interactions across travel, finance, and technical support domains.
  • Model Performance Auditing: Evaluating AI model performance across standardized qualitative and quantitative metrics, focusing strictly on task completion accuracy, conversational naturalness, and audio comprehension.
  • Technical Metric Evaluation: Assessing the model's basic computer programming literacy, including its understanding of JSON structures, functions, methods, and ability to reason about structured data within a support context.
  • Representative Dataset Generation: Contributing to the development of diverse, high-quality audio datasets that accurately reflect real customer expectations for clarity, efficiency, and natural conversational flow.
Required Expertise

To successfully fulfill the deliverables of this project, Contractors must possess deep industry knowledge to craft realistic professional scenarios. Core skillset includes:

  • Demonstrable professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
  • Native or bilingual proficiency in the target language, including fluency across all language skills (reading, listening, writing, and speaking), alongside strong analytical and verbal communication skills to confidently conduct simulated customer support role-plays.
  • Basic computer programming literacy, specifically a comfortable understanding of JSON structures, functions, methods, and simple logic.
  • A meticulous, detail-oriented approach to working with structured prompts, complex evaluation rubrics, and technical guidelines.
  • Required Equipment: Access to a high-quality microphone to ensure clean, reliable audio input during voice evaluations.

We offer a pay range of $6-to-$65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.

Engagement Type: Freelance / Independent Contractor

Workplace Type: Remote

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Italian Audio Evaluations Specialist
Italian Audio Evaluations Specialist

Meridial • United States

Remote
USD 8,300 - 90,000
German Audio Evaluations Specialist - Freelance AI Trainer Project
German Audio Evaluations Specialist - Freelance AI Trainer Project

Agency • United States

Remote
USD 8,300 - 90,000
Remote freelance contract
Flexible pay based on experience
French Audio Evaluations Specialist
French Audio Evaluations Specialist

Meridial • United States

Remote
USD 8,300 - 90,000
French Audio Evaluations Specialist - Freelance AI Trainer Project
French Audio Evaluations Specialist - Freelance AI Trainer Project

Invisible Technologies Inc. • United States

Remote
USD 8,300 - 90,000
Italian Audio Evaluations Specialist - Freelance AI Trainer Project
Italian Audio Evaluations Specialist - Freelance AI Trainer Project

Agency • United States

Remote
USD 8,300 - 90,000
Portuguese Audio Evaluations Specialist
Portuguese Audio Evaluations Specialist

Meridial • United States

Remote
USD 8,300 - 90,000
French Audio Evaluations Specialist - Freelance AI Trainer Project
French Audio Evaluations Specialist - Freelance AI Trainer Project

Agency • United States

Remote
USD 8,300 - 90,000
Remote work
Portuguese Audio Evaluations Specialist - Freelance AI Trainer Project
Portuguese Audio Evaluations Specialist - Freelance AI Trainer Project

Invisible Technologies Inc. • United States

Remote
USD 8,300 - 90,000
Dutch Audio Specialist
Dutch Audio Specialist

Meridial • United States

Remote
USD 8,300 - 90,000
Portuguese Audio Evaluations Specialist - Freelance AI Trainer Project
Portuguese Audio Evaluations Specialist - Freelance AI Trainer Project

Agency • United States

Remote
USD 8,300 - 90,000