Remote Dutch Voice AI Evaluator Flexible Contract Role

Datalabeljobs; United States; Remote; USD 30,000 - 52,000; Part time

Job summary

Alignerr is seeking native Dutch speakers for a remote contract role to evaluate AI-powered healthcare receptionist interactions. You will role-play as a patient, record short conversations, and assess how well the AI listens, responds, and takes action.

You will review transcripts, flag issues such as mispronunciations and incorrect function calls, and use detailed labeling guidelines to ensure high-quality evaluations.

Qualifications

• Native or near-native Dutch speaker with clear, natural speaking voice.
• Detail-oriented with patience to review recordings and transcripts.
• Comfortable role-playing as a patient and sounding authentic.
• Able to follow multi-step instructions and apply them consistently.
• Reliable and self-directed when working independently.

Responsibilities

• Hold 4 to 5 minute spoken conversations in Dutch with an AI front desk assistant, playing a fictional patient.
• Say natural "trigger phrases" to test whether the AI makes the correct function calls (e.g., checking a patient record, booking an appointment, or checking insurance).
• Review transcripts and classify how accurately the AI understood you and responded.
• Flag issues such as mispronunciations, cutoffs, interruptions, delays, and incorrect function calls, including timestamps.
• Test how the AI handles background noise, short replies, long numbers, emotional moments, and sensitive or unsafe requests.
• Follow detailed labeling guidelines consistently and submit high-quality work.

Skills

Dutch language

Attention to detail

Clear speaking voice

Self-directed

Job description

Alignerr is seeking native Dutch speakers for a remote contract role to evaluate AI-powered healthcare receptionist interactions. You will role-play as a patient, record short conversations, and assess how well the AI listens, responds, and takes action.

You will review transcripts, flag issues such as mispronunciations and incorrect function calls, and use detailed labeling guidelines to ensure high-quality evaluations.