Remote German Audio Evaluation Expert

Agency; United States; Remote; USD 8,300 - 90,000; Full time

Benefits offered by this job

Remote freelance contract

Flexible pay based on experience

Job summary

Agency is seeking independent Audio Evaluation Specialists for an AI benchmark evaluation project. You\'ll design evaluation frameworks, run role-play scenarios, audit outputs, and help create high-quality audio datasets for real-world customer support contexts in travel, finance, and tech support.

Candidates should have deep experience in professional customer support or conversational AI evaluation, native/bilingual proficiency in the target language, and fundamental JSON literacy.

Qualifications

• Professional experience in complex customer support, technical troubleshooting, or AI evaluation.
• Fluent reading, listening, writing, and speaking in the target language.
• Strong analytical and verbal communication skills for simulated role-plays.

Responsibilities

• Design and execute complex evaluation scenarios across domains.
• Audit AI outputs and generate structured training data.
• Evaluate model performance using qualitative and quantitative metrics.
• Contribute to diverse audio dataset development.

Skills

Customer support expertise

Bilingual proficiency

Verbal communication

Analytical thinking

Tools

JSON structures

Job description

Agency is seeking independent Audio Evaluation Specialists for an AI benchmark evaluation project. You\'ll design evaluation frameworks, run role-play scenarios, audit outputs, and help create high-quality audio datasets for real-world customer support contexts in travel, finance, and tech support.

Candidates should have deep experience in professional customer support or conversational AI evaluation, native/bilingual proficiency in the target language, and fundamental JSON literacy.