Spanish Audio Evaluation Specialist

Agency; United States; Remote; USD 65,000 - 90,000; Full time

Job summary

Agency is seeking someone to create and execute role-play-based evaluation scenarios that simulate realistic customer service interactions for advanced agentic audio models.

You will help develop diverse and representative datasets and assess model performance using standardized qualitative and quantitative metrics.

The role emphasizes ensuring evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow, supporting benchmarking efforts.

Qualifications

• Fluent in Spanish reading, listening, writing, and speaking.
• Strong fluency in English.
• Excellent verbal communication in simulated support contexts.
• Access to a high-quality microphone.
• Basic programming literacy including JSON concepts.
• Ability to reason about structured data and simple logic.
• Capable of handling large technical documentation.

Responsibilities

• Create and execute role-play-based evaluation scenarios simulating realistic customer service interactions
• Contribute to the development of diverse and representative datasets for conversational audio agents
• Evaluate model performance across standardized qualitative and quantitative metrics
• Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow

Skills

Spanish language proficiency

English fluency

Verbal communication

Structured data reasoning

Audio recording basics

Tools

JSON basics

JSON structures

Audio software

Job description

Agency is seeking someone to create and execute role-play-based evaluation scenarios that simulate realistic customer service interactions for advanced agentic audio models.

You will help develop diverse and representative datasets and assess model performance using standardized qualitative and quantitative metrics.

The role emphasizes ensuring evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow, supporting benchmarking efforts.