Remote AI Audio Benchmark Evaluator

Invisible Technologies Inc.; France; Remote; EUR 7,400 - 80,000; Full time

Job summary

Invisible Technologies Inc. is seeking independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models.

This remote freelance role involves designing evaluation scenarios, auditing model outputs, and generating clean datasets from real-world customer support contexts such as bookings, finance, and telecom. Applicants should have expert knowledge in complex customer support or conversational AI evaluation, native-level language fluency, and basic JSON

Qualifications

• Demonstrated expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Native or bilingual proficiency in the target language with reading, listening, writing and speaking skills.
• Basic JSON literacy to reason about structured data.

Responsibilities

• Design and execute role-play evaluation scenarios across domains.
• Audit model outputs using quantitative and qualitative metrics.
• Generate diverse, high-quality audio datasets reflecting real customer interactions.

Skills

Customer support expertise

AI evaluation

Verbal communication

JSON literacy

Job description

Invisible Technologies Inc. is seeking independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models.

This remote freelance role involves designing evaluation scenarios, auditing model outputs, and generating clean datasets from real-world customer support contexts such as bookings, finance, and telecom. Applicants should have expert knowledge in complex customer support or conversational AI evaluation, native-level language fluency, and basic JSON