AI Quality & Reliability Engineer (Python, GenAI & AWS/Azure) | IDC Technologies | Abu Dhabi

IDC Technologies

Abu Dhabi

On-site

AED 350,000 - 550,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

IDC Technologies in Abu Dhabi, UAE, seeks an AI Quality & Reliability Engineer (QA/SRE) with 5+ years of hands-on experience for a permanent on-site role. You will own automated testing frameworks, LLM evaluation, RAG pipelines, and cloud infrastructure reliability on AWS and Azure.

You will build CI/CD pipelines with Terraform and GitHub Actions, monitor system health with Grafana/Prometheus, and perform load testing with JMeter and K6 while collaborating with cross-functional teams to ensure

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, AI, Software Engineering, or related field.
  • Minimum 5+ years of hands-on experience in software quality assurance, automation testing, or SRE.
  • Strong Python and PyTest automation experience.
  • Experience with AI/GenAI testing, LLM evaluation, and RAG architectures.
  • Cloud platforms (AWS, Azure) and AI services (Azure OpenAI, AWS Bedrock).
  • Infrastructure-as-code (Terraform), CI/CD (GitHub Actions), and SRE observability (Grafana/Prometheus).
  • Strong analytical, problem-solving, and stakeholder communication skills.
  • Legal work authorization and on-site availability in Abu Dhabi.

Responsibilities

  • Design, develop, and run automated testing frameworks using Python and PyTest.
  • Validate Generative AI models, LLMs, and RAG evaluation pipelines.
  • Manage cloud AI services on AWS and Azure (Azure OpenAI, AWS Bedrock).
  • Build CI/CD pipelines with Terraform and GitHub Actions.
  • Monitor reliability and performance via Grafana and Prometheus.
  • Conduct load/stress testing with JMeter and K6.
  • Collaborate with data scientists, software engineers, and DevOps teams.
  • Ensure AI safety, data quality, and security compliance.

Skills

Python
PyTest
JMeter
K6
Terraform
GitHub Actions
Grafana
Prometheus
SRE observability
CI/CD pipelines
Cloud (AWS, Azure)
AI/GenAI testing
Communication

Education

Bachelor’s or Master’s degree in CS/AI/SE

Tools

Docker
Kubernetes
Terraform
GitHub Actions
Jira
Confluence
ServiceNow
Grafana
Prometheus

Job description

Position Summary:

Driving advanced artificial intelligence quality assurance, reliability engineering, and Generative AI testing in Abu Dhabi, United Arab Emirates, IDC Technologies is actively seeking an experienced AI Quality & Reliability Engineer (QA/SRE) with 5+ years of progressive professional experience for a permanent full-time professional engagement. In this vital AI reliability and testing role, you will take full operational, tactical, and technical ownership of automated testing frameworks, LLM evaluation pipelines, RAG system validation, cloud infrastructure reliability on AWS and Azure (Azure OpenAI and AWS Bedrock), CI/CD pipelines, Terraform automation, and site reliability engineering (SRE) observability across distributed Grafana and Prometheus monitoring systems. Bringing deep technical proficiency in Python, PyTest, JMeter, and K6 performance load testing, you will empower an elite technology solutions and IT consulting corporation to achieve uncompromised AI model stability, bulletproof system resilience, and superior production performance. This prestigious career opportunity offers competitive remuneration, enterprise client exposure, and professional growth within a leading global IT recruitment and software solutions corporation.

Detailed Job Description:

As an AI Quality & Reliability Engineer supporting IDC Technologies on a professional on-site basis in Abu Dhabi, United Arab Emirates, you will take full operational, tactical, and technical ownership of AI testing strategies, quality assurance automation, SRE observability, and cross-functional engineering collaboration. Your day-to-day responsibilities include designing, developing, and executing comprehensive automated test suites using Python and PyTest, validating Generative AI models, Large Language Models (LLMs), and Retrieval-Augmented Generation (RAG) evaluation frameworks, managing cloud infrastructure and AI services on AWS and Azure (including Azure OpenAI and AWS Bedrock), building and maintaining CI/CD deployment pipelines utilizing Terraform and GitHub Actions, monitoring production health, system reliability, and performance metrics via Grafana and Prometheus, executing load and stress testing using JMeter and K6, collaborating proactively with software development squads, data scientists, and technical recruitment leadership like Shweta Kasgar at IDC Technologies, adhering to strict corporate quality and security standards, and managing application requirements by submitting your updated CV via direct email to shweta.kasgar@idctechnologies.com.

Key Responsibilities:
  • Design, develop, and execute robust automated testing frameworks and test scripts utilizing Python and PyTest.
  • Validate, test, and evaluate Generative AI models, Large Language Models (LLMs), and RAG (Retrieval-Augmented Generation) pipelines.
  • Administer and configure cloud-based AI services and infrastructure on AWS and Azure, including Azure OpenAI and AWS Bedrock.
  • Build, optimize, and maintain CI/CD deployment pipelines utilizing Terraform and GitHub Actions.
  • Monitor system reliability, uptime, SLOs, and performance metrics across Grafana and Prometheus dashboards.
  • Execute comprehensive load, stress, and performance testing using JMeter and K6 to identify scalability bottlenecks.
  • Collaborate proactively with cross-functional data science, software engineering, and DevOps squads.
  • Ensure strict adherence to AI safety standards, data quality benchmarks, and enterprise security compliance frameworks.
  • Maintain meticulous test automation documentation, test case repositories, SRE runbooks, and incident post-mortem logs.
  • Participate actively in sprint planning, code reviews, and root-cause analysis (RCA) sessions for AI production anomalies.
Required Qualifications & Skills:
  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Software Engineering, or a related technical discipline.
  • Minimum of 5+ years of progressive professional hands-on experience in software quality assurance, automation testing, or site reliability engineering.
  • Strong, demonstrable operational proficiency in Python programming and PyTest automation frameworks.
  • Comprehensive working knowledge and practical hands-on experience with AI/GenAI testing, LLM evaluation, and RAG architectures.
  • Solid practical grasp of cloud platforms (AWS, Azure) and specialized AI managed services (Azure OpenAI, AWS Bedrock).
  • Proven expertise in infrastructure-as-code (Terraform), CI/CD pipelines (GitHub Actions), and SRE observability (Grafana, Prometheus).
  • Strong analytical problem-solving skills and effective stakeholder communication capabilities.
  • Mandatory legal work authorization and physical availability for professional on-site operations in Abu Dhabi, UAE.
Nice-to-Have Skills:
  • Professional vendor certifications such as AWS Certified DevOps Engineer, Microsoft Certified: Azure AI Engineer Associate, or ISTQB Advanced Test Automation Engineer.
  • Prior professional working experience supporting Tier-1 global artificial intelligence enterprises, financial institutions, or SaaS corporations.
  • Hands-on familiarity with containerization platforms (Docker, Kubernetes) and chaos engineering tools.
  • Experience utilizing enterprise agile tracking and IT service desk platforms (Jira, Confluence, ServiceNow).
  • Active participation in AI research communities, SRE user groups, or open-source testing frameworks.
Application Information:
  • Recruiter: IDC Technologies Recruitment Division
  • Contact Name: Shweta Kasgar (Senior IT Recruiter | Talent Acquisition Specialist)
  • Email: shweta.kasgar@idctechnologies.com
  • Phone:
  • Company Website: https://www.idctechnologies.com
  • Salary/Rate: Market Competitive / Enterprise AI Engineering Package
  • Work Schedule: On-Site Professional Operations (Abu Dhabi, UAE)
  • Deadline: Open until filled (Urgent Abu Dhabi AI QA/SRE Opening)
  • Notice Period: Immediate to 15 Days Joiner Required
  • Contract Duration: Permanent / Full-Time Employment
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Quality & Reliability Engineer (QA/SRE) | Dicetek | UAE
AI Quality & Reliability Engineer (QA/SRE) | Dicetek | UAE

Dicetek • United Arab Emirates

On-site
AED 300,000 - 540,000
AI Quality & Reliability Engineer (QA/SRE) | Talent Arabia | UAE
AI Quality & Reliability Engineer (QA/SRE) | Talent Arabia | UAE

Tech Junction Ltd • United Arab Emirates

On-site
AED 260,000 - 420,000
AI Change & Adoption Professional | IDC Technologies | Abu Dhabi, UAE
AI Change & Adoption Professional | IDC Technologies | Abu Dhabi, UAE

Tech Junction Ltd • Abu Dhabi

On-site
AED 120,000 - 180,000
AI Quality & Reliability Engineer – On-Site Abu Dhabi
AI Quality & Reliability Engineer – On-Site Abu Dhabi

IDC Technologies • Abu Dhabi

On-site
AED 350,000 - 550,000
AI Tech Lead / Solution Architect | Abu Dhabi, UAE
AI Tech Lead / Solution Architect | Abu Dhabi, UAE

Tech Junction Ltd • Abu Dhabi

On-site
AED 808,000 - 1,322,000
Program Manager – AI & Data Transformation | Abu Dhabi, UAE
Program Manager – AI & Data Transformation | Abu Dhabi, UAE

Tech Junction Ltd • Abu Dhabi

On-site
AED 600,000 - 1,000,000
Delivery Lead – Agentic AI | IDC Technologies | Abu Dhabi, UAE
Delivery Lead – Agentic AI | IDC Technologies | Abu Dhabi, UAE

Tech Junction Ltd • Abu Dhabi

On-site
AED 300,000 - 550,000
AI Engineer – Cybersecurity Automation | IDC Technologies | Abu Dhabi, UAE
AI Engineer – Cybersecurity Automation | IDC Technologies | Abu Dhabi, UAE

Tech Junction Ltd • Abu Dhabi

On-site
AED 300,000 - 500,000
AI Ops Engineer | IDC Technologies | Abu Dhabi
AI Ops Engineer | IDC Technologies | Abu Dhabi

Tech Junction Ltd • Abu Dhabi

On-site
AED 250,000 - 450,000
AI Engineer - Junior
AI Engineer - Junior

Datamatics Technologies LLC • Abu Dhabi, Dubai

Remote
AED 240,000 - 360,000
Top locations