AI Reliability Engineer: Quality, SRE & AI Testing

Showcify, Inc.

Abu Dhabi

Hybrid

AED 240,000 - 320,000

Full time

6 days ago

Be an early applicant

Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Showcify, Inc. is seeking an AI Quality & Reliability Engineer to own the Production Readiness of our cloud-based AI solutions in a hybrid role combining automated testing, AI model evaluation, and SRE.

You will design and implement automated testing frameworks (Python, PyTest, Selenium/Robot Framework) for AI services on Azure or AWS, validate infrastructure state, and monitor SLIs/SLOs to assure performance and safety for banking-scale environments.

Qualifications

Proficiency in Python for AI testing and automation.
Experience with CI/CD pipelines and automated test suites.
Knowledge of SRE practices, resiliency testing, and security checks.
Understanding of AI evaluation metrics (hallucination, ROUGE/ BLEU).
Familiarity with Azure and/or AWS cloud environments.

Responsibilities

Design and execute automated testing frameworks for AI services (Azure OpenAI, AWS Bedrock) including model accuracy and safety testing.
Implement Chaos Engineering and load testing to ensure banking-scale reliability.
Build CI/CD-integrated test suites validating application and IaC state.
Define and monitor SLIs/SLOs; set up alerting in cloud monitoring tools.
Automate security scans and compliance checks for data residency and privacy.