AI QA & Reliability Engineer (SRE) – Banking Cloud

Tech Junction Ltd; Abu Dhabi; On-site; AED 240,000 - 360,000; Full time

Job summary

Halian in Abu Dhabi, UAE is seeking an experienced AI Quality & Reliability Engineer (QA/SRE) to own testing of AI/LLM systems within a banking-industry client. You’ll drive production readiness, implement automated test suites with PyTest, Selenium, and Robot Framework, and oversee observability with Grafana and Prometheus.

Ideal candidates have 6+ years in software quality assurance, cloud engineering, and SRE, strong Python proficiency, hands-on Azure/AWS experience, and a track record in

Qualifications

• Bachelor's or Master's degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline.
• Minimum 6+ years of professional experience spanning software quality assurance, cloud engineering, and site reliability engineering (SRE).
• Strong programming proficiency in Python and hands-on expertise with testing frameworks (PyTest, Selenium, Robot Framework).
• Practical hands-on experience deploying and managing enterprise workloads on Azure and/or AWS cloud platforms.
• Proven experience conducting load testing, performance tuning, and chaos engineering (K6, JMeter).
• Specialized expertise in AI/LLM testing, prompt evaluation, and RAG pipeline accuracy verification.
• Solid operational knowledge of observability platforms including Grafana, Prometheus, Azure Monitor, and CloudWatch.
• Familiarity with security, compliance, and auditing requirements in banking-grade production environments.
• Professional availability for full-time employment in Abu Dhabi, UAE.

Responsibilities

• Design, build, and execute automated testing frameworks for cloud-based AI solutions and LLM applications.
• Spearhead SRE initiatives, observability monitoring, and incident response runbooks in banking environments.
• Conduct load testing, stress testing, chaos engineering, and scalability evaluations using K6 and JMeter.
• Perform specialized AI/LLM testing, prompt evaluation, and Retrieval-Augmented Generation (RAG) evaluation.
• Configure, maintain, and analyze infrastructure monitoring telemetry via Grafana, Prometheus, Azure Monitor, and AWS CloudWatch.
• Implement CI/CD pipelines with automated infrastructure validation checks.
• Validate banking-grade security baselines, data compliance protocols, and high-availability production architectures.
• Write robust test automation scripts utilizing Python, PyTest, Selenium, and Robot Framework.
• Collaborate with ML developers, cloud architects, and financial stakeholders.
• Maintain comprehensive technical documentation, test coverage reports, failure analysis logs, and SRE post-mortem reviews.

Skills

Python

Testing frameworks

SRE

Load testing

CI/CD

Education

Bachelor's or Master's in CS/Engineering

Tools

Azure

AWS

Grafana

Prometheus

JMeter

K6

CloudWatch

PyTest

Selenium

Robot Framework

Terraform

Ansible

Kubernetes

Job description

Halian in Abu Dhabi, UAE is seeking an experienced AI Quality & Reliability Engineer (QA/SRE) to own testing of AI/LLM systems within a banking-industry client. You’ll drive production readiness, implement automated test suites with PyTest, Selenium, and Robot Framework, and oversee observability with Grafana and Prometheus.

Ideal candidates have 6+ years in software quality assurance, cloud engineering, and SRE, strong Python proficiency, hands-on Azure/AWS experience, and a track record in