Remote French Audio Evaluation Specialist

Agency; United States; Remote; USD 8,300 - 90,000; Part time

Benefits offered by this job

Remote work

Job summary

Agency seeks independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models in real-world customer support scenarios across travel, finance, and telecom. You will design evaluation tasks, simulate interactions, and audit AI outputs to build clean datasets for model refinement.

We require native/bilingual English proficiency and strong communication, plus basic JSON literacy.

Qualifications

• Demonstrable professional expertise in complex customer support, technical troubleshooting, or conversational AI evaluation.
• Native or bilingual proficiency in the target language, including fluency reading, listening, writing and speaking, with strong analytical and verbal communication.
• Basic programming literacy, specifically understanding JSON structures, functions, methods, and simple logic.
• Meticulous, detail-oriented approach to structured prompts, evaluation rubrics, and technical guidelines.

Responsibilities

• Role-Play Scenario Execution: Creating and executing complex, role-play-based evaluation scenarios across travel, finance, and technical support.
• Model Performance Auditing: Evaluating AI model performance using qualitative and quantitative metrics for accuracy and naturalness.
• Technical Metric Evaluation: Assessing JSON-related understanding and reasoning within a support context.
• Representative Dataset Generation: Contributing to diverse audio datasets reflecting real customer expectations.

Skills

Audio evaluation

Customer support

Conversational AI

Data annotation

Tools

JSON

Job description

Agency seeks independent Audio Evaluation Specialists for an AI benchmark project evaluating agentic audio models in real-world customer support scenarios across travel, finance, and telecom. You will design evaluation tasks, simulate interactions, and audit AI outputs to build clean datasets for model refinement.

We require native/bilingual English proficiency and strong communication, plus basic JSON literacy.