Senior QA Automation Engineer for AI Agentic Systems

GCS Recruitment Specialists; Abu Dhabi; On-site; AED 240,000 - 420,000; Full time

Job summary

GCS Recruitment Specialists in Abu Dhabi is seeking a Senior QA Automation Engineer to lead testing of agentic AI systems. You will design and run frameworks that validate complex models, drawings, and regulatory documents, ensuring trust and compliance in automated decisions.

You will own testing across integration, API, and performance, focusing on non-deterministic AI behaviors, grounding, and tool-use verification, with clear reporting and modern QE practices.

Qualifications

• 5+ years of QA automation or quality engineering experience.
• Experience testing ML models, LLM apps, or AI agents.
• Independent operator who can scope and build testing frameworks.

Responsibilities

• Agentic System Testing: evaluate tool selection, multi-step trajectories, and recovery from failures.
• Grounding and citation verification to ensure outputs are supported by sources.
• Honest-failure and refusal calibration to avoid unwanted outputs and refusals.
• Guardrail and adversarial testing for prompt injections and untrusted data handling.
• Multi-turn and state validation to ensure continuity across sessions.
• AI & LLM validation: develop regression suites and judge outputs using gold standards.
• Live production quality: monitor and evaluate live outputs and trigger alerts for regressions.

Skills

Python

LLM evaluation

Agent tracing

CI/CD

SQL data validation

Performance testing

Test automation libraries

Version control

QA reporting

Job description

GCS Recruitment Specialists in Abu Dhabi is seeking a Senior QA Automation Engineer to lead testing of agentic AI systems. You will design and run frameworks that validate complex models, drawings, and regulatory documents, ensuring trust and compliance in automated decisions.

You will own testing across integration, API, and performance, focusing on non-deterministic AI behaviors, grounding, and tool-use verification, with clear reporting and modern QE practices.