Korean AI Quality & Language Evaluator

Remotedxb; Dubai; On-site; AED 167,000 - 279,000; Full time

Job summary

Productive Playhouse is seeking a Korean language AI evaluator to join our global data team. You will test AI chatbots and language models through structured conversations, including voice sessions, to help improve the models.

Applicants should be native or expert Korean, have strong English skills, and be comfortable with assessments, smartphone and internet access, and both written and spoken communication.

Qualifications

• Native or expert-level fluency in Korean.
• Strong English reading, writing, and communication skills.
• Hands-on experience using AI models or large language models.
• Ability to pass language proficiency and technical literacy assessments.
• Access to a smartphone, computer, and reliable internet.

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts.
• Participate in voice-based interactions with AI models, including recorded sessions.
• Submit deliverables such as write-ups, ratings, screenshots, or recordings in specified formats.
• Assess AI capabilities, safety, and helpfulness to inform model development.

Skills

Korean language proficiency

English proficiency

Experience with AI models

Job description

Productive Playhouse is seeking a Korean language AI evaluator to join our global data team. You will test AI chatbots and language models through structured conversations, including voice sessions, to help improve the models.

Applicants should be native or expert Korean, have strong English skills, and be comfortable with assessments, smartphone and internet access, and both written and spoken communication.