AI Quality Assurance Lead — Gen AI & Automation

RAKBANK

Dubai

On-site

AED 250,000 - 520,000

Full time

13 days ago

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

RAKBANK is seeking an experienced Assistant Manager – Automation and AI Engineer to lead quality engineering across AI, Generative AI, Conversational AI and Intelligent Automation initiatives. This hands‑on role ensures AI-powered solutions are accurate, secure, and production‑ready while driving automation excellence.

You will define AI testing strategies, evaluate LLMs, design testing frameworks, and mentor teams across Product, Engineering and Data Science.

Qualifications

Bachelor's degree required with 8–10 years of testing experience.
Experience leading QA/automation in banking tech projects preferred.
Strong expertise in Generative AI, Conversational AI, and AI quality assurance methodologies.

Responsibilities

Lead end-to-end quality engineering for AI and automation solutions across Generative AI, Conversational AI, and intelligent automation.
Define AI testing strategies, evaluation frameworks, and release-readiness criteria.
Evaluate LLMs for accuracy, safety, latency, and cost; develop RAG evaluation frameworks.
Design AI testing frameworks covering prompt validation and model regression.
Build automated testing solutions using Python, PyTest, Playwright, API automation, and CI/CD gates.
Mentor QA and automation teams and collaborate with Product, Engineering, and Data Science.