Italian AI Audio Evaluator for Customer Support

Agency; United States; A distancia; USD 90.000 - 130.000; Jornada completa

Descripción de la vacante

Agency is seeking individuals to create and run advanced evaluation scenarios for customer service interactions. You will assess AI model performance across qualitative and quantitative metrics, focusing on task completion and naturalness, while evaluating literacy in JSON structures.

The role includes contributing to diverse, high-quality audio data collection. Ideal candidates have native Italian proficiency, a background in customer support or AI evaluation, and basic programming literacy.

Formación

• Native or bilingual proficiency in Italian.
• Experience in customer support, technical troubleshooting, or conversational AI evaluation.
• Basic programming literacy with JSON, functions, methods, and simple logic.
• Access to a high-quality microphone.
• Meticulous attention to detail with structured prompts and evaluation rubrics.

Responsabilidades

• Create and execute complex evaluation scenarios simulating customer service interactions.
• Evaluate AI model performance using qualitative and quantitative metrics.
• Assess model programming literacy, including JSON structures and reasoning about structured data.
• Contribute to the development of diverse, high-quality audio datasets.

Conocimientos

Native Italian

AI evaluation experience

Customer service background

JSON basics

Attention to detail

Herramientas

JSON

Python basics

Descripción del empleo

Agency is seeking individuals to create and run advanced evaluation scenarios for customer service interactions. You will assess AI model performance across qualitative and quantitative metrics, focusing on task completion and naturalness, while evaluating literacy in JSON structures.

The role includes contributing to diverse, high-quality audio data collection. Ideal candidates have native Italian proficiency, a background in customer support or AI evaluation, and basic programming literacy.