Swahili AI Product Evaluator

Remotedxb; Dubai; On-site; AED 60,000 - 90,000; Full time

Job summary

Productive Playhouse in Dubai, UAE, seeks a role focused on testing and evaluating AI chatbots and language models. You will conduct structured conversations to meet assigned goals and prompts, and participate in voice-based interactions with AI systems.

The position requires native Swahili (Kenya dialect) and strong English skills, plus hands-on AI model experience and the ability to pass proficiency assessments. A smartphone, computer, and reliable internet are essential.

Qualifications

• Native or expert-level fluency in Swahili (Kenya dialect).
• Strong English reading, writing, and communication skills.
• Hands-on experience using AI models or large language models.
• Ability to pass language proficiency and technical literacy assessments.
• Possession of a smartphone, computer, and reliable internet.
• 18 years of age or older.

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Participate in voice-based interactions with AI models, including recorded sessions
• Submit deliverables such as write-ups, ratings, screenshots, or recordings in specified formats
• Assess AI capabilities, safety, and helpfulness to inform model development

Skills

Swahili fluency

English proficiency

AI model experience

Technical literacy assessments

Smartphone/computer required

18+ years old

Job description

Responsibilities

• Test and evaluate AI chatbots or language models through structured conversations using assigned goals and prompts
• Participate in voice-based interactions with AI models, including recorded sessions
• Submit deliverables such as write-ups, ratings, screenshots, or recordings in specified formats
• Assess AI capabilities, safety, and helpfulness to inform model development

Requirements

• Native or expert-level fluency in Swahili (Kenya dialect)
• Strong English reading, writing, and communication skills
• Hands-on experience using AI models or large language models
• Ability to pass language proficiency and technical literacy assessments
• Possession of a smartphone, computer, and reliable internet
• 18 years of age or older

About the Company

Productive Playhouse is a global data and language services company dedicated to preserving languages and cultures through transcription, translation, localization, and AI evaluation.