AI Assurance QA Engineer — Conversational AI Quality

Cognizant; Dubai; On-site; AED 180,000 - 240,000; Full time

Job summary

Cognizant in Dubai is seeking an experienced AI Assurance Quality Engineer to ensure the quality, reliability, and performance of AI-powered conversational systems, including chatbots, virtual assistants, and RAG/agentic AI solutions.

The role focuses on testing non-deterministic AI outputs, developing test automation in Python, and evaluating LLM-based applications across airline/travel domains such as Amadeus Altéa, Sabre, Navitaire, and GDS/NDC environments.

Qualifications

• 4+ years of software quality engineering experience.
• Strong Python scripting skills.
• Experience testing LLM-based and Conversational AI systems.

Responsibilities

• Design and execute test plans for AI-powered chatbots and assistants.
• Evaluate non-deterministic outputs using rubrics and golden datasets.

Skills

Python scripting

Software Quality Engineering

Test automation

LLM testing

Job description

Cognizant in Dubai is seeking an experienced AI Assurance Quality Engineer to ensure the quality, reliability, and performance of AI-powered conversational systems, including chatbots, virtual assistants, and RAG/agentic AI solutions.

The role focuses on testing non-deterministic AI outputs, developing test automation in Python, and evaluating LLM-based applications across airline/travel domains such as Amadeus Altéa, Sabre, Navitaire, and GDS/NDC environments.