Mandarin Chinese - Voice AI Evaluator

Datalabeljobs; United States; Remote; USD 21,000 - 41,000; Part time

Job summary

Alignerr is seeking native Mandarin Chinese speakers to role-play as patients and evaluate AI healthcare front desk conversations. This fully remote, contract (task-based) role involves recording brief dialogues, rating AI comprehension, and flagging issues with timestamps.

You must have a clear speaking voice, attention to detail, and the ability to follow labeling guidelines. Flexibility and self-direction are valued; prior voice AI evaluation or healthcare background is a plus but not

Qualifications

• Native Mandarin Chinese speaker with clear, natural voice.
• Detail-oriented with patience to review recordings and transcripts.
• Able to role-play a patient and sound authentic.
• Able to follow multi-step instructions and apply them consistently.
• Reliable and self-directed when working independently.
• Access to a quiet space, good microphone, stable internet, and a second device for background noise.
• Comfortable using web-based tools.

Responsibilities

• Hold 4 to 5 minute spoken conversations in Mandarin Chinese with an AI front desk assistant, playing a fictional patient.
• Say natural "trigger phrases" to test whether the AI makes the correct function calls (e.g., checking a patient record, booking an appointment, or checking insurance).
• Review transcripts and classify how accurately the AI understood you and responded.
• Flag issues such as mispronounced words or tones, cutoffs, interruptions, delays, and incorrect function calls, including timestamps.
• Test how the AI handles background noise, short replies ("好的," "是的," "不用了"), long numbers, emotional moments, and sensitive or unsafe requests.
• Follow detailed labeling guidelines consistently and submit high-quality work.

Skills

Mandarin accuracy

Attention to detail

Role-playing authenticity

Multi-step instruction following

Independent work

Quiet workspace setup

Web-based tools

Job description

Mandarin Chinese Voice AI Evaluator (Healthcare Front Desk Conversations)

What if your voice could help teach AI how to handle a real phone call to a hospital or clinic? We're looking for native Mandarin Chinese speakers to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action.

You'll role-play as a patient (using fictional personas we provide), record short conversations, and grade the AI's performance. This is a fully remote, flexible contract role for people with clear speech, sharp attention to detail, and an ear for what sounds natural.

• Organization: Alignerr
• Type: Contract (task-based)
• Location: Remote
• Commitment: Flexible, work at your own pace

What You'll Do

• Hold 4 to 5 minute spoken conversations in Mandarin Chinese with an AI front desk assistant, playing a fictional patient
• Say natural "trigger phrases" to test whether the AI makes the correct function calls (for example, checking a patient record, booking an appointment, or checking insurance)
• Review transcripts and classify how accurately the AI understood you and responded
• Flag issues such as mispronounced words or tones, cutoffs, interruptions, delays, and incorrect function calls, including timestamps
• Test how the AI handles background noise, short replies ("好的," "是的," "不用了"), long numbers, emotional moments, and sensitive or unsafe requests
• Follow detailed labeling guidelines consistently and submit high-quality work

Who You Are

• Native or near-native Mandarin Chinese speaker with a clear, natural speaking voice
• Detail-oriented, with the patience to review recordings and transcripts closely
• Comfortable role-playing a patient and sounding authentic
• Able to follow multi-step instructions and apply them consistently
• Reliable and self-directed when working independently
• Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise
• Comfortable using web-based tools

Nice to Have

• Experience in voice AI evaluation, data annotation, or QA testing
• Background in healthcare administration, customer service, or call center work
• Sensitivity to tones, regional accents, and natural colloquial Mandarin (Mainland China, Taiwan, or elsewhere)
• Linguistics or language-focused studies
• Familiarity with medical terminology in Chinese

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible
• Task-based work with real autonomy
• Directly help make voice AI more accurate, natural, and safe in healthcare settings
• Potential for ongoing work as new projects launch
• Note: New contributors complete a short unpaid qualification assessment. Contributors who pass are added to paid production work.