Italian-Speaking JSON & Audio Evaluation Specialist

Upwork; Lombardia; Remote; EUR 83,000 - 117,000; Part time

Job summary

Upwork is seeking Italian-speaking coding experts with JSON expertise to support evaluation and improvement of AI-generated audio responses. The project starts immediately and runs for 2-3 months, with potential extension based on need.

Experts will participate in live scenarios, review transcripts, evaluate AI outputs for language quality, technical accuracy, and JSON structure, and provide written justifications using structured rubrics.

Qualifications

• Fluent in Italian with strong JSON knowledge.
• Experience evaluating AI-generated responses and transcripts.
• Ability to use rubrics to judge language quality and technical accuracy.

Responsibilities

• Participating in live, real-time conversational scenarios with AI systems.
• Reviewing and labeling conversation transcripts.
• Evaluating AI-generated responses using structured rubrics and providing written justifications.
• Assessing responses for language quality, customer experience, technical accuracy, formatting, and JSON structure.
• Capturing required session artifacts, including recordings, Session IDs, and tool-call/console logs.

Skills

JSON fluency

Coding knowledge

Italian language

Quality review

Tools

JSON

Job description

Upwork is seeking Italian-speaking coding experts with JSON expertise to support evaluation and improvement of AI-generated audio responses. The project starts immediately and runs for 2-3 months, with potential extension based on need.

Experts will participate in live scenarios, review transcripts, evaluate AI outputs for language quality, technical accuracy, and JSON structure, and provide written justifications using structured rubrics.