Director, AI Systems Engineering & Evaluation

Novartis Ireland

Dublin

Hybrid

EUR 102,000 - 190,000

Full time

2 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hybrid working options
Parental leave 14 weeks

Job summary

Novartis Ireland is seeking a Senior AI Leader in Dublin to design, build and productionise shared AI foundations used across Development AI systems. You will drive reusable agentic architectures, memory, tool integration and agent-oriented templates that scale across projects.

You will also define evaluation frameworks, establish red teaming and production-readiness criteria, and coach data scientists and engineers while collaborating with DSAI leadership, Strategy & Governance and Product

Qualifications

  • 10+ years in Data Science or AI with production AI/ML experience.
  • Hands-on with agentic frameworks and turning prototypes into production-grade capabilities.
  • Experience defining evaluation approaches, benchmarks and production-readiness for LLM/agentic systems.
  • Experience leading senior technical teams and external partners in regulated environments; pharma or life sciences preferred.

Responsibilities

  • Develop and execute a roadmap for shared AI foundations of Development.
  • Architect, prototype and productionise reusable agentic components and templates.
  • Define evaluation frameworks covering reliability, grounding and auditability.
  • Establish red teaming and adversarial testing for agentic systems with cybersecurity.
  • Set production-readiness criteria and monitoring; support GxP-relevant systems.
  • Define MLOps/LLMOps/AgentOps practices and partner with platforms teams.

Skills

Senior AI leadership
Agentic frameworks
LLM evaluation
Regulated environments
Team leadership

Tools

LangGraph
AutoGen
CrewAI

Job description

Summary

Location: Dublin, Ireland - Hybrid

Relocation is not offered for this role. Please apply if the location is accessible to you.

This is a senior AI leader role within Novartis Global Drug Development (GDD), responsible for designing, building and productionising the shared foundations that every Development AI system runs on. Think reusable agentic architectures, agent-accessible tools and knowledge (e.g. via MCP), evaluation harnesses, Physical AI patterns, and AgentOps pipelines, so that AI systems reach production faster, behave reliably and accelerate drug development timelines and time-to-patient.

The role sits at the intersection of deep technical expertise (agentic frameworks, RAG, evaluation science, data and knowledge foundations) and strategic influence, setting the technical direction for how AI systems across Development are built, tested and trusted, in close collaboration with DSAI domain leaders, Product teams, Strategy & Governance and DDIT.

Beyond hands-on design and delivery, the position carries accountability for evaluation and reliability: agent and model evaluation frameworks (reliability, hallucination risk, task completion, regulatory-grade auditability), red teaming, monitoring and production-readiness criteria, and the technical evidence that links each AI system to the business outcomes it is meant to deliver. The leader coaches and develops data scientists and AI engineers at the frontier of applied AI in pharma, and builds external visibility through publications and conference presentations. It requires 10+ years of production AI/ML experience with specific fluency in agentic design patterns, evaluation and responsible-AI practices.

The role owns reusable AI foundations and the technical evidence of AI quality. Product roadmaps and value realisation sit with Product teams, policy and approvals with Strategy & Governance, and platforms and infrastructure operations with DDIT.

About The Role
Major accountabilities
  • Develop and execute a roadmap for the shared AI foundations of Development, including reusable agentic architectures, retrieval and knowledge systems, simulation and digital twins, so that each new system builds on the last
  • Architect, prototype and productionise reusable agentic components: agent orchestration, memory and context management, tool integration and human-in-the-loop patterns, delivered as templates and reference implementations that domain teams can extend
  • Define agent and model evaluation frameworks covering reliability, hallucination risk, grounding, task completion rate and regulatory-grade auditability, and build the shared benchmark suites, evaluation datasets and test harnesses that apply them
  • Establish red teaming and adversarial testing for agentic systems (prompt injection, jailbreaks, retrieval attacks, tool misuse) in partnership with cybersecurity
  • Set production-readiness criteria and monitoring for AI systems in Development, including drift, degradation and failure-mode analysis, and support technical validation of GxP-relevant systems
  • Define MLOps, LLMOps and AgentOps practices (versioning, orchestration, tracing, observability) and partner with DDIT so the required signals are built into the platforms they run
  • Design and implement the data and knowledge foundations that agentic systems depend on for grounded, trustworthy decision-making; integrate internal/external data sources, APIs and knowledge bases as agent-accessible tools with appropriate access controls and governance
  • Connect technical performance evidence to the business-value KPIs each AI system is meant to move, working with Product teams so that decisions to scale, fix or retire rest on objective evidence
  • Turn proven project-level solutions into reusable capabilities, reducing duplication and time-to-build across domains
  • Strategically coordinate and prioritise team and partner resources across initiatives; proactively manage risks, stakeholder expectations and competing priorities
  • Proactively evaluate the evolving AI landscape (e.g. reasoning models, agent frameworks, MCP, evaluation tooling) and guide technology selection
  • Publish and present at conferences and academic institutions; serve as a Novartis ambassador for applied and agentic AI
  • Coach and develop data scientists and AI engineers in agentic design patterns, evaluation and responsible AI practices
Minimum Requirements
  • 10+ years in Data Science or AI, with demonstrable experience building and deploying production AI/ML systems
  • Hands-on experience with agentic frameworks (e.g. LangGraph, AutoGen, CrewAI, or equivalent) and with turning prototypes into reusable, production-grade capabilities
  • Proven experience defining evaluation approaches, benchmarks and production-readiness criteria for LLM or agentic systems
  • Experience leading senior technical teams and external partners in complex, regulated environments; healthcare or life sciences experience preferred
Rewards

At Novartis, we’re committed to reimagining medicine together - and rewarding the people who make it happen.

The rewards of being part of our team go far beyond base pay and incentives.We also offer a variety of competitive benefits in kind to help you thrive personally and professionally, such as insurance plans, retirement plans, wellbeing resources and global recognition programs. In addition, we provide flexible and hybrid working options, where possible, and a minimum of 14 weeks paid parental leave.

Expected Annual Base Salary Range For Role
  • Ireland: 102,200.00 - 189,800.00 EUR Annual

The salary offered is determined based on gender-neutral objectives, such as relevant skills, competencies and experience in accordance with the Novartis pay setting policy and upon joining Novartis will be reviewed periodically.

In addition to your base salary, you may be eligible for a performance-based bonus depending on certain performance parameters. Further details will be provided during the application process.

Pay equity is a fundamental principle of our employment policy and reflects our commitment to create a diverse, equitable and inclusive environment that treats all employees with dignity and respect, as outlined in our Code of Ethics.

Read our brochure to learn more about our global total rewards offering: https://www.novartis.com/sites/novartis_com/files/novartis-life-handbook.pdf

Note: Benefits and compensation may vary by country and are subject to local legal requirements, including provisions of collective bargaining agreements where applicable. A full overview of your compensation package, including any relevant collective bargaining agreement details applicable to your role based on your employment location and Novartis employer entity, will be communicated separately to you during the application process.

Commitment To Diversity And Inclusion / EEO Paragraph

Novartis is committed to building an outstanding, inclusive work environment and diverse teams’ representative of the patients and communities we serve.

Why Novartis:

Helping people with disease and their families takes more than innovative science. It takes a community of smart, passionate people like you. Collaborating, supporting and inspiring each other. Combining to achieve breakthroughs that change patients’ lives. Ready to create a brighter future together? https://www.novartis.com/about/strategy/people-and-culture

Benefits and Rewards:

Read our handbook to learn about all the ways we’ll help you thrive personally and professionally. https://www.novartis.com/careers/benefits-reward

Why Novartis:

Helping people with disease and their families takes more than innovative science. It takes a community of smart, passionate people like you. Collaborating, supporting and inspiring each other. Combining to achieve breakthroughs that change patients’ lives. Ready to create a brighter future together? https://www.novartis.com/about/strategy/people-and-culture

Benefits and Rewards:

Learn about all the ways we’ll help you thrive personally and professionally.

Read our handbook (PDF 30 MB)

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Director, AI Systems Engineering & Evaluation
Director, AI Systems Engineering & Evaluation

Novartis AG • Dublin

Hybrid
EUR 102,000 - 190,000
Hybrid working options
14 weeks paid parental leave
Insurance plans
Director, AI Systems Foundations & Reusable Capabilities
Director, AI Systems Foundations & Reusable Capabilities

IE02 (FCRS = IE002) Novartis Ireland Ltd • Dublin

Hybrid
EUR 102,000 - 190,000
Hybrid work options
Global recognition programs
Competitive benefits
Associate Director, Applied AI (FDE)
Associate Director, Applied AI (FDE)

Novartis AG • Dublin

Hybrid
EUR 89,000 - 166,000
Insurance plans
Retirement plans
Wellbeing resources
+3
Director: AI Systems Reliability, Testing & Performance
Director: AI Systems Reliability, Testing & Performance

IE02 (FCRS = IE002) Novartis Ireland Ltd • Dublin

Hybrid
EUR 102,000 - 190,000
Insurance plans
Retirement plans
Wellbeing resources
+3
Associate Director & Senior Principal Data Science, AI for Biologics
Associate Director & Senior Principal Data Science, AI for Biologics

Novartis Ireland • Dublin

On-site
EUR 89,000 - 166,000
insurance plans
retirement plans
wellbeing resources
+3
Associate Director & Senior Principal Data Science, AI for Biologics
Associate Director & Senior Principal Data Science, AI for Biologics

IE02 (FCRS = IE002) Novartis Ireland Ltd • Dublin

On-site
EUR 89,000 - 166,000
Flexible and hybrid working options
14 weeks parental leave
Comprehensive benefits
Marketing Lead - Contract Manufacturing
Marketing Lead - Contract Manufacturing

Novartis AG • Leinster

Hybrid
EUR 120,000 - 180,000
Flexible hybrid working
minimum 14 weeks paid parental leave
Insurance plans
+3
Implementation and Strategic Initiatives Director
Implementation and Strategic Initiatives Director

IE02 (FCRS = IE002) Novartis Ireland Ltd • Dublin

On-site
EUR 90,000 - 168,000
Performance-based bonus
Flexible and hybrid working options
14 weeks parental leave
Therapeutic Area Head Immunology, Neuroscience and CRM
Therapeutic Area Head Immunology, Neuroscience and CRM

IE02 (FCRS = IE002) Novartis Ireland Ltd • Dublin

Hybrid
EUR 104,000 - 192,000
Hybrid working options
14 weeks parental leave
Company vehicle or car allowance
+2
Trial Vendor Associate Director, Community Lead
Trial Vendor Associate Director, Community Lead

Novartis Ireland • Dublin

Hybrid
EUR 76,000 - 141,000
Insurance plans
Retirement plans
Wellbeing resources
+2
Top locations