AI Tester - Arabic Speaker (m/f/d)

Showcify, Inc.; Abu Dhabi; On-site; AED 180,000 - 240,000; Full time

Job summary

Halian Group is seeking an Arabic-speaking AI Tester to validate the quality, reliability, and performance of a customer-facing chatbot. The role emphasizes linguistic accuracy across Khaleeji, Misri and Shami dialects to ensure a natural, culturally appropriate user experience.

Responsibilities include designing test plans, executing black-box tests, and performing integration, performance, and security testing using Azure-based tools and Python scripting.

Qualifications

• Up to 9 years of hands-on testing experience, focused on functional and non-functional testing.
• Fluent in Khaleeji, Misri, and Shami dialects, written and spoken.
• Strong English (written and spoken) for international reporting.
• Experience designing test cases and test plans across multiple testing types.
• Black-box testing experience in a customer-facing digital/AI product.
• Solid understanding of AI concepts and quality expectations.
• Hands-on experience with Azure-based testing environments.
• Python scripting skills to support test automation.
• Strong analytical skills to translate findings into clear reports in English and Arabic.

Responsibilities

• Design, develop, and execute comprehensive test plans for an AI chatbot platform.
• Perform black-box testing from Arabic-speaking users’ perspective across dialects.
• Evaluate dialectal accuracy, cultural relevance, and language naturalness.
• Identify gaps and provide actionable feedback to development teams.
• Evaluate AI outputs against expected behaviors across language interactions.
• Balance testing: ~75% functional/non-functional, ~25% performance/security.
• Conduct integration testing with connected systems and APIs.
• Log and communicate defects clearly in English and Arabic.

Skills

Arabic dialects

English proficiency

Test case design

Azure testing

Python scripting

Black-box testing

AI quality understanding

Team collaboration

Tools

Azure tooling

Job description

AI Tester – Arabic Speaking

A forward-thinking organisation is investing in the development of intelligent conversational AI solutions and is seeking a hands-on, Arabic-speaking AI Tester to ensure the quality, reliability, and performance of a customer-facing AI chatbot. This role is critical in validating the chatbot's effectiveness across diverse Arabic-speaking user groups, ensuring linguistic accuracy, dialectal appropriateness, and seamless customer experience. This is a practitioner role — ideal for someone who thrives in execution and enjoys working at the cutting edge of AI quality assurance.

Responsibilities:

• Design, develop, and execute comprehensive test plans and test cases covering functional, non-functional, integration, performance, and security testing across an AI chatbot platform.
• Perform black-box testing from the Arabic-speaking customer's perspective, evaluating chatbot behaviour, conversational accuracy, linguistic quality, and overall user experience across multiple Arabic dialects.
• Assess chatbot responses for dialectal accuracy, cultural relevance, and language naturalness across Khaleeji (Gulf), Misri (Egyptian), Shami (Levantine), and other regional Arabic variations, ensuring the chatbot communicates appropriately with diverse Arabic-speaking audiences.
• Identify linguistic gaps, dialectal mismatches, and culturally inappropriate responses, providing detailed and actionable feedback to development teams.
• Apply an understanding of AI and machine learning principles to evaluate chatbot outputs against expected behaviours across varied Arabic language interactions.
• Execute the full range of testing activities with a primary focus on functional and non-functional testing (approximately 75%), complemented by performance and security testing (approximately 25%).
• Conduct integration testing to validate seamless interaction between the chatbot and connected systems and APIs.
• Carry out performance testing to assess chatbot responsiveness, scalability, and stability under varied load conditions.Support security testing activities to identify vulnerabilities and ensure the platform meets required compliance and data protection standards.
• Utilise Azure-based testing tools and Python scripting to automate and enhance testing processes.
• Log, track, and clearly communicate defects and test outcomes in both English and Arabic, working closely with the Test Lead and development teams to drive resolution.

Qualifications and Skills:

• Up to 9 years of hands-on testing experience, with a strong focus on functional and non-functional testing.
• Fluency across multiple Arabic dialects — including Khaleeji, Misri, and Shami — in both written and spoken form is essential. The ability to evaluate chatbot interactions authentically from the perspective of users across these dialect groups is a core requirement of this role.
• Strong professional proficiency in English, both written and spoken, with the ability to communicate technical findings, test outcomes, and defect reports clearly to an international team.
• Proven experience designing test cases and test plans across multiple testing types — integration, performance, security, and functional.
• Black-box testing experience, ideally within a customer-facing digital or conversational AI product environment.
• Solid understanding of AI concepts and what constitutes quality, accuracy, and appropriate behaviour in an AI chatbot — practical development of AI is not required, but familiarity with AI capabilities and customer expectations is essential.
• Hands-on experience with Azure-based testing environments.
• Python scripting skills to support test automation and data validation.Strong analytical skills with the ability to interpret technical outputs and translate findings into clear, actionable reporting in both English and Arabic.
• Collaborative team player, comfortable operating within a structured team reporting to a Test Lead.

Halian Group: With over 28 years of experience, we have come to understand that innovation is the only way to provide agile, practical solutions that transform businesses and careers. Our resourcing and smart services help you to realize tomorrow's potential. Discover the amazing things possible when you bring the right people and the right technologies together.

At Halian, we recognise that diversity, equity, and inclusion (DEI) are essential to building high-performing teams for our clients. We are committed to connecting organisations with top talent from all backgrounds, ensuring that every individual feels valued, respected, and empowered to contribute their unique perspectives. We encourage applications from all qualified candidates, regardless of race, gender, disability, or any other characteristic that makes them unique. By fostering diverse and inclusive workplaces, we help our clients drive innovation, enhance collaboration, and better reflect the communities they serve.

#LI-PG1