Korean Voice AI Evaluator (AI Training, Remote)

Alignerr Corp.; Greater London; À distance; GBP 25 000 - 58 000; Temps partiel

Résumé du poste

Alignerr is seeking native or near-native Korean speakers in London to remotely evaluate healthcare front desk conversations with an AI assistant. You will hold 4–5 minute Korean conversations, test triggers like booking appointments or checking records, and rate the AI's performance.

This contract, task-based role offers flexible scheduling and remote work, with the requirement to review transcripts, flag issues, and follow labeling guidelines for high-quality data in healthcare AI.

Qualifications

• Native or near-native Korean speaker with clear speaking voice.
• Ability to follow detailed labeling guidelines and multi-step instructions.
• Comfortable role-playing as a patient and testing AI behavior.

Responsabilités

• Hold 4–5 minute spoken conversations in Korean with an AI receptionist.
• Test AI actions by triggering functions like booking or record checks.
• Review transcripts and rate understanding and responses.
• Flag mispronunciations, cutoffs, interruptions, and other issues with timestamps.
• Ensure testing covers noise, short replies, numbers, and sensitive requests.

Connaissances

Korean language proficiency

Detail-oriented

Self-directed

Outils

Web-based tools

Description du poste

Korean Voice AI Evaluator (Healthcare Front Desk Conversations)

About The Role

What if your voice could help teach AI how to handle a real phone call to a hospital or clinic? We're looking for native Korean speakers based in London to hold natural spoken conversations with an AI healthcare receptionist, then evaluate how well it listens, responds, and takes action.

London's diverse, internationally connected Korean-speaking community makes it a key talent hub for this type of language and evaluation work. You'll role-play as a patient using fictional personas we provide, record short conversations, and grade the AI's performance — fully remotely, entirely on your own schedule.

• Organization: Alignerr
• Type: Contract (task-based)
• Location: Remote
• Commitment: Flexible, work at your own pace

What You'll Do

• Hold 4 to 5 minute spoken conversations in Korean with an AI front desk assistant, playing a fictional patient
• Say natural trigger phrases to test whether the AI makes the correct function calls — for example, checking a patient record, booking an appointment, or checking insurance
• Review transcripts and classify how accurately the AI understood you and responded
• Flag issues such as mispronunciations, cutoffs, interruptions, delays, and incorrect function calls, including timestamps
• Test how the AI handles background noise, short replies ("네," "아니요," "괜찮아요"), long numbers, emotional moments, and sensitive or unsafe requests
• Follow detailed labeling guidelines consistently and submit high-quality work

Who You Are

• Native or near-native Korean speaker with a clear, natural speaking voice
• Detail-oriented, with the patience to review recordings and transcripts closely
• Comfortable role-playing a patient and sounding authentic
• Able to follow multi-step instructions and apply them consistently
• Reliable and self-directed when working independently
• Access to a quiet space, a good microphone, a stable internet connection, and a second device for playing background noise
• Comfortable using web-based tools

Nice to Have

• Experience in voice AI evaluation, data annotation, or QA testing
• Background in healthcare administration, customer service, or call center work
• Strong sense of Korean speech levels and politeness (존댓말) in service conversations, and of how Korean numbers are read aloud (native vs. Sino-Korean)
• Linguistics or language-focused studies
• Familiarity with medical terminology in Korean

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Task-based work with real autonomy
• Directly help make voice AI more accurate, natural, and safe in healthcare settings
• Potential for ongoing work as new projects launch

Note: New contributors complete a short unpaid qualification assessment. Contributors who pass are added to paid production work.