QA Engineer for AI Agentic Apps — Precision Testing

Deutsche Bank AG; Dubai; Hybrid; AED 230,000 - 320,000; Full time

Benefits offered by this job

Best in class leave policy

Gender neutral parental leaves

Sponsorship for Industry relevantcerts

Employee Assistance Program

Hospitalization Insurance

Accident and Term life Insurance

Complementary Health screening

Job summary

Deutsche Bank AG in Dubai is seeking a Quality Assurance Engineer to validate AI agentic applications across development and production. You will design, build, and execute test strategies for LLM accuracy, RAG ingestion and attribution, and agent planning with tool use.

The role emphasizes automated testing, AI safety, and continuous quality measurement across releases, with a focus on grounding, prompt engineering, and governance in high-stakes environments.

Qualifications

• 5+ years in software quality assurance and testing.
• Hands-on experience testing GenAI, LLM, or agentic AI.
• Strong automation framework background and utilities.
• Proficient in at least one language: Java or Python.
• Familiar with LLM evaluation tools and evaluation metrics.

Responsibilities

• Design, implement and maintain AI testing strategies and automation frameworks.
• Validate LLM-powered applications for accuracy, grounding, and hallucinations.
• Evaluate autonomous/semi-autonomous AI agents and recovery behaviors.
• Assess RAG performance: ingestion, embedding accuracy, and citations.
• Perform AI safety testing for prompts, data leakage, tool use, and privileges.
• Establish metrics and QA gates across releases and deployments.
• Develop and maintain automated test suites (APIs, UI, integration, RAG).
• Analyze production AI interactions to identify failures and create regression tests.

Skills

QA testing

GenAI testing

Automation frameworks

Java/Python

LLM evaluation

Prompt engineering

Education

Bachelor's degree in CS/Engineering

Tools

Langsmith

Langfuse

RAG tools

Vector DBs

CI/CD

Job description

Deutsche Bank AG in Dubai is seeking a Quality Assurance Engineer to validate AI agentic applications across development and production. You will design, build, and execute test strategies for LLM accuracy, RAG ingestion and attribution, and agent planning with tool use.

The role emphasizes automated testing, AI safety, and continuous quality measurement across releases, with a focus on grounding, prompt engineering, and governance in high-stakes environments.