Director of AI Reliability, Testing & Performance

IE02 (FCRS = IE002) Novartis Ireland Ltd; Dublin; Hybrid; EUR 102,000 - 190,000; Full time

Benefits offered by this job

Insurance plans

Retirement plans

Wellbeing resources

Global recognition programs

Flexible and hybrid working options

14 weeks paid parental leave

Job summary

Novartis Ireland Ltd in Dublin is seeking a Director of AI Systems Reliability, Testing & Performance to define how AI systems are evaluated, tested, validated, and monitored across Development. You will own the technical evidence that demonstrates reliability, robustness, security, and fitness-for-use over time.

This senior role leads AI evaluation science, validation, and performance intelligence, shaping benchmarks, drift detection, and production-readiness.

Qualifications

• Minimum 10+ years in AI, ML, software engineering, quality, risk, validation, or tech governance.
• Experience deploying or overseeing business-critical AI systems.
• Experience establishing governance, controls, quality standards, or operational frameworks.
• Experience defining evaluation approaches and performance metrics.
• Experience managing operational risk in regulated environments.
• Experience partnering with infrastructure and platform teams.

Responsibilities

• AI Evaluation & Benchmarking: define evaluation methodologies for AI systems, models, agents, digital twins, and simulation environments.
• AI Testing & Validation: establish validation methodologies for agentic systems, digital twins, and real-world readiness.
• Reliability, Monitoring & Performance: define metrics for reliability and monitoring over time across AI systems.
• AI Security & Adversarial Testing: define red teaming and adversarial testing approaches for AI systems.
• Technical Evidence & AI Performance Intelligence: create standard reporting for benchmark results and validation findings.

Skills

AI leadership

Regulated environments

Governance & controls

Performance metrics

Infra collaboration

Job description

Novartis Ireland Ltd in Dublin is seeking a Director of AI Systems Reliability, Testing & Performance to define how AI systems are evaluated, tested, validated, and monitored across Development. You will own the technical evidence that demonstrates reliability, robustness, security, and fitness-for-use over time.

This senior role leads AI evaluation science, validation, and performance intelligence, shaping benchmarks, drift detection, and production-readiness.