Korean AI Product Evaluator

Remotedxb; Dubai; On-site; AED 167,000 - 279,000; Full time

Job summary

Productive Playhouse is seeking a Korean language AI evaluator to join our global data team. You will test AI chatbots and language models through structured conversations, including voice sessions, to help improve the models.

Applicants should be native or expert Korean, have strong English skills, and be comfortable with assessments, smartphone and internet access, and both written and spoken communication.

Qualifications

• Native or expert-level fluency in Korean.
• Strong English reading, writing, and communication skills.
• Hands-on experience using AI models or large language models.
• Ability to pass language proficiency and technical literacy assessments.
• Access to a smartphone, computer, and reliable internet.

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts.
• Participate in voice-based interactions with AI models, including recorded sessions.
• Submit deliverables such as write-ups, ratings, screenshots, or recordings in specified formats.
• Assess AI capabilities, safety, and helpfulness to inform model development.

Skills

Korean language proficiency

English proficiency

Experience with AI models

Job description

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Participate in voice-based interactions with AI models, including recorded sessions
• Submit deliverables such as write-ups, ratings, screenshots, or recordings in specified formats
• Assess AI capabilities, safety, and helpfulness to inform model development

Requirements

• Native or expert-level fluency in Korean (South Korea)
• Strong English reading, writing, and communication skills
• Hands‑on experience using AI models or large language models
• Ability to pass language proficiency and technical literacy assessments
• Access to a smartphone, computer, and reliable internet
• Comfortable with both written and voice-based conversation

About the Company

Productive Playhouse is a global data company specializing in language acquisition and cultural experience. They offer a wide range of data services including transcription, translation, linguistic analysis, and AI evaluation to help preserve languages and improve AI understanding.