Kinyarwanda AI Product Evaluator

Remotedxb; Dubai; On-site; AED 89,000 - 134,000; Full time

Job summary

Productive Playhouse in Dubai seeks a detail‑oriented AI evaluation specialist to test and rate chatbots and language models. You will engage in structured conversations, participate in voice sessions, and document results with clear write-ups and recordings.

Ideal candidates are fluent in Kinyarwanda and English, comfortable with AI tools, and have reliable equipment and internet. You will help assess safety and usefulness to support ongoing model improvements.

Qualifications

• Kinyarwanda fluency at native or expert level.
• Strong reading and writing in English.
• Hands-on experience with AI models or large language models.
• Access to smartphone, computer and reliable internet.

Responsibilities

• Test and evaluate AI chatbots using structured conversations.
• Participate in voice-based sessions with AI models.
• Submit deliverables such as write-ups, ratings, and recordings.
• Assess AI capabilities to inform model development.

Skills

Kinyarwanda proficiency

English proficiency

AI model experience

Digital literacy

Job description

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Participate in voice-based interactions with AI models, including recorded sessions
• Submit deliverables such as write-ups, ratings, screenshots, or recordings in specified formats
• Assess AI capabilities, safety, and helpfulness to inform model development

Requirements

• Native or expert-level fluency in Kinyarwanda (as spoken in Rwanda)
• Strong English reading, writing, and communication skills
• Hands-on experience using AI models or large language models
• Possession of a smartphone, computer, and reliable internet
• Ability to pass language proficiency and technical literacy assessments
• 18 years of age or older

About the Company

Productive Playhouse is a global data company specializing in transcription, translation, linguistic analysis, and AI evaluation. Their mission is to keep languages and cultures alike through high-quality data services.