Senior AI Validation & QA Automation Engineer

cander; Abu Dhabi; In loco; AED 320.000 - 520.000; Tempo pieno

Descrizione del lavoro

Sister Company of the Client in Abu Dhabi, United Arab Emirates seeks a Senior QA Automation Engineer to lead AI validation for defense-grade systems. You will design automated tests for non-deterministic AI outputs, ensuring LLMs meet reliability standards and pass Stage Gate reviews.

You will collaborate with Data Scientists and Systems Engineers to align tests with Ground Truth datasets and formal acceptance criteria, integrating with SAP S/4HANA and Ariba.

Competenze

• 5+ years in QA automation for data-driven apps, ML models or AI agents
• Experience in defense/aerospace or regulated industries is a plus
• Expert Python with Pytest and automation libs
• Experience with IV&V processes desirable

Mansioni

• Architect automated testing frameworks for non-deterministic AI outputs (hallucinations, consistency, factual accuracy)
• Design automated evaluation metrics (RAGAS, faithfulness, relevance) for LLMs and pipelines
• Develop prompt regression suites to monitor drift and maintain doc quality
• Create integration tests validating data between AI agents and SAP S/4HANA/Ariba
• Build performance tests for latency/throughput of forecasting models and risk engines
• Automate API validation and RBAC/PII redaction before data ingestion

Conoscenze

Python (Pytest)

Selenium/Playwright

SQL

GitLab CI/CD

LLM evaluation

Test automation

Performance testing

Strumenti

Pytest

Selenium

Playwright

Locust

JMeter

K6

Great Expectations

Jira

Polarion

GitLab

TestRail

Allure

Descrizione del lavoro

Sister Company of the Client in Abu Dhabi, United Arab Emirates seeks a Senior QA Automation Engineer to lead AI validation for defense-grade systems. You will design automated tests for non-deterministic AI outputs, ensuring LLMs meet reliability standards and pass Stage Gate reviews.

You will collaborate with Data Scientists and Systems Engineers to align tests with Ground Truth datasets and formal acceptance criteria, integrating with SAP S/4HANA and Ariba.