Senior AI Safety & Evaluation Architect

Abu Dhabi Commercial Bank; Abu Dhabi; On-site; AED 600,000 - 1,000,000; Full time

Benefits offered by this job

Medical insurance

Paid leave

Education assistance

Flexible/Remote working options

Job summary

Abu Dhabi Commercial Bank (ADCB) seeks a Senior Manager for AI Safety and Evaluation Engineering to lead advanced evaluation, safety, and governance of AI systems within the UAE banking domain.

You will design standardized rubrics, implement XAI techniques, and collaborate with MLOps teams to ensure real-time visibility, risk compliance, and secure AI deployments across the organization.

Qualifications

• Bachelor's degree in information technology, Computer Science, Engineering or related discipline.
• Proven Python expertise and experience with ML eval pipelines.
• Experience with XAI libraries and LLM evaluation frameworks.
• Ability to design observability and monitoring systems at scale.

Responsibilities

• Design, implement, and scale technical measures to ensure AI solution reliability, safety, and security; liaise with second-line risk to meet risk and compliance standards.
• Define standardized evaluation rubrics and scoring for AI performance, safety, and reliability across GenAI archetypes.
• Create comprehensive test cases for deterministic logic, probabilistic outputs, and edge cases, including adversarial scenarios.
• Implement explainability and fairness measures to ensure model transparency and regulatory compliance in lending and fraud.
• Collaborate with MLOps/LMMOps teams to embed capabilities into the platform and telemetry pipelines.
• Establish a unified Safety Stack for monitoring, testing, and explainability across the AI portfolio.

Skills

Python

Statistical testing

XAI techniques

LLM evaluation

Observability

Education

Bachelor's degree in information technology, Computer Science, Engineering or related discipline

Tools

Ragas

Giskard

Arize

Job description

Abu Dhabi Commercial Bank (ADCB) seeks a Senior Manager for AI Safety and Evaluation Engineering to lead advanced evaluation, safety, and governance of AI systems within the UAE banking domain.

You will design standardized rubrics, implement XAI techniques, and collaborate with MLOps teams to ensure real-time visibility, risk compliance, and secure AI deployments across the organization.