Italian-Speaking JSON & Coding Evaluator

Lifted, an Upwork Company™; Milano; On-site; EUR 34,000 - 62,000; Part time

Job summary

SmartRecruiters, Inc. seeks Italian-speaking JSON & Coders to support evaluation and improvement of AI-generated audio responses. The 2-3 month contract offers flexible schedules and on-site work in Milano.

You will review transcripts, label data, and assess outputs for linguistic quality, technical accuracy, and proper JSON formatting. Ideal candidates are detail-oriented, fluent in Italian, and capable of providing clear written justifications.

Qualifications

• Fluent Italian with strong JSON understanding.
• Ability to read and validate JSON structures accurately.
• Excellent attention to detail for labeling and scoring responses.

Responsibilities

• Participating in live, real-time conversational scenarios with AI systems.
• Reviewing and labeling conversation transcripts.
• Evaluating AI-generated responses using structured rubrics and providing written justifications.
• Assessing responses for language quality, customer experience, technical accuracy, formatting, and JSON structure.
• Capturing required session artifacts, including recordings, Session IDs, and tool-call/console logs.

Skills

JSON

Italian language

Attention to detail

Quality assessment

Job description

SmartRecruiters, Inc. seeks Italian-speaking JSON & Coders to support evaluation and improvement of AI-generated audio responses. The 2-3 month contract offers flexible schedules and on-site work in Milano.

You will review transcripts, label data, and assess outputs for linguistic quality, technical accuracy, and proper JSON formatting. Ideal candidates are detail-oriented, fluent in Italian, and capable of providing clear written justifications.