AI Assurance Quality Engineer

Cognizant; Dubai; On-site; AED 300,000 - 500,000; Full time

Job summary

Cognizant is seeking an experienced AI Assurance Quality Engineer to ensure quality, reliability, and performance of AI-powered conversational systems, including chatbots, virtual assistants, and RAG/agentic AI solutions. The role requires strong software quality engineering background and hands-on experience with Python-based test automation.

The ideal candidate will bring airline/travel industry domain knowledge (Amadeus Altéa, Sabre, Navitaire, PSS/Reservation systems, GDS & NDC) and a track

Qualifications

• 4+ years of Software Quality Engineering experience.
• Strong Python scripting skills with experience building test automation tools/frameworks.
• Hands-on testing experience for LLM-based applications, conversational AI systems, chatbots and RAG/agentic AI solutions.
• Mandatory airline/travel domain expertise: Amadeus Altéa, Sabre, Navitaire; PSS/Reservation systems; GDS & NDC; IATA Fare Construction; Fare Rules & Ancillaries; IROPS; Payments & Refunds.

Skills

Python scripting

Test automation

LLM testing

Conversational AI

Chatbots/Virtual Assistants

RAG/Agentic AI

Context management

Function/Tool calling

Retrieval mechanisms

AI failure modes

Quality metrics

Job description

We are looking for an experienced AI Assurance Quality Engineer to ensure the quality, reliability, and performance of AI-powered conversational systems, including chatbots, virtual assistants, RAG applications, and agentic AI solutions.

Key Requirements

4+ years of Software Quality Engineering experience

Strong Python scripting skills with experience building test automation tools/frameworks

Hands-on experience testing:

• LLM-based applications
• Conversational AI systems
• Chatbots & Virtual Assistants
• RAG and Agentic AI solutions

Strong understanding of:

• Prompt Engineering
• Context Management
• Function/Tool Calling
• Retrieval Mechanisms
• AI Failure Modes & Quality Risks

Experience evaluating non-deterministic AI outputs using:

• Golden Datasets
• Rubric-Based Assessments
• LLM-as-a-Judge Frameworks
• Human Review Workflows
• Statistical Quality Metrics

Mandatory Domain Experience

Strong Airline/Travel Industry expertise in:

• Amadeus Altéa, Sabre, or Navitaire
• PSS / Reservation Systems
• GDS & NDC
• IATA Fare Construction
• Fare Rules & Ancillaries
• IROPS
• Payments & Refunds

CogAE106