Cloud AI Quality & Reliability Engineer (SRE & AI Testing)

Halian; United Arab Emirates; On-site; AED 180,000 - 240,000; Full time

Job summary

Halian is seeking an experienced AI Quality & Reliability Engineer to ensure quality, performance and resilience of cloud-based AI solutions in banking. The role blends AI testing, automation, cloud engineering and SRE practices for robust systems.

The ideal candidate has 6+ years of experience with Python testing (PyTest/Selenium/Robot Framework), cloud platforms (Azure/AWS) and observability tools, and will work across CI/CD, AI/LLM testing and RAG evaluations.

Qualifications

• At least 6 years of relevant experience.
• Strong Python testing skills with PyTest, Selenium, Robot Framework.
• Experience with Azure and/or AWS cloud platforms.
• Knowledge of SRE, reliability engineering and observability.
• Experience with load testing and chaos engineering.
• Familiarity with K6 and/or JMeter.
• CI/CD and infrastructure validation experience.
• AI/LLM testing and prompt engineering knowledge.
• Experience with RAG evaluation and monitoring tools.

Responsibilities

• Support quality, performance and reliability testing of cloud-based AI solutions.
• Work with automation testing frameworks and Python-based testing tools.
• Support reliability engineering, observability and SRE practices.
• Perform load testing and contribute to chaos engineering activities.
• Validate CI/CD pipelines and infrastructure.
• Support AI/LLM testing, prompt engineering and RAG evaluation.
• Work with monitoring and observability platforms.
• Support security, compliance and production reliability requirements in banking environments.

Skills

Python testing skills

Tools

PyTest

Selenium

Robot Framework

Azure

AWS

K6

JMeter

Grafana

Prometheus

CloudWatch

Azure Monitor

CI/CD

Job description

Halian is seeking an experienced AI Quality & Reliability Engineer to ensure quality, performance and resilience of cloud-based AI solutions in banking. The role blends AI testing, automation, cloud engineering and SRE practices for robust systems.

The ideal candidate has 6+ years of experience with Python testing (PyTest/Selenium/Robot Framework), cloud platforms (Azure/AWS) and observability tools, and will work across CI/CD, AI/LLM testing and RAG evaluations.