Copy of Dutch-Speaking JSON & Coding Experts for Audio Evaluations

Lifted (an Upwork Company); Belgique; Remote; EUR 25.000 - 44.000; Vollzeit

Zusammenfassung

Himalayas is seeking Dutch-speaking coding experts with JSON expertise for an enterprise evaluation project focused on AI-generated outputs in audio format. You will join a high-volume, remote assignment with flexible scheduling, starting immediately and running for 2–3 months, with potential extension.

A basic computational concepts assessment is required and not compensated. Ideal candidates combine language proficiency, JSON prowess, and strong attention to detail, enabling precise evaluation

Qualifikationen

• Fluency in Dutch (Canada/US/UK variant) required.
• JSON literacy: reading, validating, troubleshooting, and identifying formatting issues.
• Strong written communication and attention to detail.
• Ability to produce clear audio with no background noise.

Aufgaben

• Participate in live, real-time conversational evaluations.
• Review and label conversation transcripts.
• Evaluate AI responses using rubrics and provide written justifications.
• Assess responses for language quality, customer experience, technical accuracy, formatting, and JSON structure.
• Capture session artifacts including recordings and Session IDs.
• Prepare environment and verify tools before each session.

Kenntnisse

Dutch fluency

JSON fluency

Attention to detail

Written communication

Audio setup

Jobbeschreibung

Tasks

• Participating in live, real-time conversational scenarios with AI systems
• Reviewing and labeling conversation transcripts
• Evaluating AI-generated responses using structured rubrics and providing written justifications
• Assessing responses for language quality, customer experience, technical accuracy, formatting, and JSON structure
• Capturing required session artifacts, including recordings, Session IDs, and tool-call/console logs
• Environment preparation and tool verification before each session

Experts should speak naturally and spontaneously, as if responding in real time, without pre-planned, written, or scripted responses - the client is evaluating natural voice cadence. To be considered for this project, experts are required to pass a basic computational concepts assessment (JSON structures, function, general reasoning, and language proficiency), which takes about 15 minutes to complete, and will not be compensated. If the expert passes the assessment, they will be provided with further onboarding steps.

Operator Requirements

• Strong spoken-language proficiency: C1/C2-level fluency (CEFR) in the target evaluation language, verified through a speaking/listening assessment, not just a resume claim.
• Technical literacy: JSON fluency required - reading, validating, troubleshooting, and identifying structural/formatting issues
• Audio setup: capable of producing clear audio quality with no background noise

Ideal experts will have strong attention to detail, strong written communication skills, and the ability to evaluate both the customer experience and the technical correctness of a response. A solid understanding of JSON is especially important, including the ability to read, validate, troubleshoot, and identify structural or formatting issues.

An Enterprise client is seeking a high volume of Dutch-speaking coding experts with JSON expertise to combine language fluency, customer service judgment, and technical evaluation skills to help improve the quality, accuracy, and usability of AI-generated outputs, in an audio format.

Work is expected to begin right away, and continue for 2-3 months, with the potential for additional work beyond this initial project. Experts may work at any schedule of their choosing, for as long as tasks are available.

Experts (Operators) will review a mix of customer service-style responses and technical content, with a strong focus on coding knowledge, JSON structure, formatting accuracy, and overall response quality. Experts should be comfortable identifying whether outputs are clear, helpful, natural, technically accurate, and aligned with project guidelines.

Fluency in Dutch, as spoken in Canada, the United States, or the United Kingdom, is required.

Experts with multilingual fluency may be offered work for this project and/or others, in additional languages.

Originally posted on Himalayas