Hindi Audio Specialist

Agency; United States; Remote; USD 30,000 - 47,000; Full time

Job summary

Agency is seeking a qualified evaluator to design and run role-play based scenarios that mimic real customer service conversations. The role involves helping build diverse datasets for audio agents and assessing model performance across multiple metrics.

You will ensure evaluations align with real customer expectations for clarity, efficiency, and natural conversational flow. Proficiency in English and Hindi, plus JSON literacy, is required.

Qualifications

• Strong fluency in English.
• Hindi reading, listening, writing and speaking.
• Basic JSON structures and functions are understood.
• Ability to reason about structured data and simple logic.
• Access to a high-quality microphone for clear audio input.

Responsibilities

• Create and execute role-play–based evaluation scenarios for customer service interactions.
• Contribute to dataset development for conversational audio agents.
• Evaluate model performance using qualitative and quantitative metrics.
• Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural flow.

Skills

English fluency

Hindi proficiency

JSON structures

Structured data reasoning

Audio evaluation

Job description

Responsibilities

• Create and execute role-play–based evaluation scenarios simulating realistic customer service interactions
• Contribute to the development of diverse and representative datasets for conversational audio agents
• Evaluate model performance across qualitative and quantitative metrics
• Ensure evaluations reflect real customer expectations for clarity, efficiency, and natural conversational flow

Requirements

• Strong fluency in English
• Hindi proficiency including reading, listening, writing, and speaking
• Access to a high-quality microphone for clean audio input
• Basic computer programming literacy including JSON structures and functions/methods
• Ability to reason about structured data and simple logic
• Device capable of running audio recording software and handling large technical documentation

About the Company

This project is dedicated to assessing and benchmarking advanced agentic audio models to optimize performance for real-world customer support use cases.