French AI Audio Evaluator for Customer-Support Simulations

Agency; United States; Remote; USD 60,000 - 90,000; Full time

Job summary

Agency is conducting a project to assess advanced agentic audio models used in real-world customer support scenarios across industries like flights, finance, and telecom. The role focuses on creating realistic evaluation prompts and measuring model accuracy and naturalness in conversations.

Ideal candidates bring native French skills, strong experience in customer support or AI evaluation, and basic JSON programming literacy, along with access to a good microphone to capture high-quality audio

Qualifications

• Native or bilingual proficiency in French.
• Expertise in complex customer support, technical troubleshooting, or AI evaluation.
• Basic programming literacy (JSON, functions, methods, and simple logic).
• Access to a high-quality microphone.
• Meticulous attention to detail with structured prompts and technical guidelines.

Responsibilities

• Create and execute complex, role-play-based evaluation scenarios simulating realistic customer service interactions
• Evaluate AI model performance using qualitative and quantitative metrics, focusing on task accuracy and conversational naturalness
• Assess model programming literacy, including JSON structures and reasoning about structured data
• Contribute to the development of diverse, high-quality audio datasets to optimize model performance

Skills

French proficiency

AI evaluation

Customer support

JSON basics

Education

Programming basics

Tools

JSON

Job description

Agency is conducting a project to assess advanced agentic audio models used in real-world customer support scenarios across industries like flights, finance, and telecom. The role focuses on creating realistic evaluation prompts and measuring model accuracy and naturalness in conversations.

Ideal candidates bring native French skills, strong experience in customer support or AI evaluation, and basic JSON programming literacy, along with access to a good microphone to capture high-quality audio