Associate Director, Data Engineer

AstraZeneca plc

España

On-site

EUR 120,000 - 170,000

Full time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AstraZeneca plc is seeking an Associate Director of Data Pipeline Engineering in Barcelona to design, implement, and maintain robust data pipelines across R&D programs. You will ensure end-to-end data flow, from ingestion to FAIR publication, with a hands-on approach and modular, reusable designs that scale with evolving scientific needs.

The role emphasizes strong software engineering practices, collaboration with scientists and engineers, and the delivery of reliable, production-ready

Qualifications

  • Strong experience designing, developing, deploying, and maintaining complex data pipelines.
  • Strong hands-on Python programming skills.
  • Experience with AWS services (S3, Lambda, Glue, Step Functions, RDS, CloudWatch, IAM).
  • Experience with relational databases, APIs, data integration & orchestration.
  • Production delivery experience & lifecycle management.

Responsibilities

  • Design, build, test, deploy, and maintain robust data pipelines.
  • Deliver end-to-end data lifecycle solutions from ingestion to publication.
  • Integrate data from internal systems, instruments, APIs, databases.
  • Build modular, configurable, and reusable pipelines for multiple projects.
  • Implement data quality, validation, provenance, traceability, and error handling.
  • Develop APIs, services, workflow components, and data infrastructure as needed.

Skills

Python programming
Data pipeline design
Software engineering practices
Git/version control
Automation and AI-assisted development

Tools

AWS
CI/CD
APIs

Job description

This is an in-office role based in Barcelona, ES, with a requirement to work a minimum of three days per week on-site . Remote or travel flexibility is not available.

Why this role matters

AstraZeneca is transforming research and development through better use of data, technology, and artificial intelligence. Within the Enterprise AI Unit, Enterprise Data Enablement develops the data capabilities needed to support AstraZeneca's core business.

The R&D Data Office is building enterprise-level capabilities to make R&D data FAIR+T- findable, accessible, interoperable, reusable, and trustworthy . Reliable data and metadata pipelines are essential to achieving this ambition. They enable data to move efficiently from scientific and laboratory systems into trusted, discoverable, and reusable data products that can support analysis, automation, and AI-enabled discovery.

As an Associate Director, you will design, implement, deploy, and maintain Data pipelines that support the end-to-end management of data and metadata across R&D priority programmes . You will work on initiatives such as SafetyOmics and AI4Assay, helping ensure that internally generated data, including multi-omics data, is captured, processed, enriched, validated, traced, and made available for scientific use.

This is a hands-on individual contributor role. You will work closely with team leadership and technical colleagues to turn project needs into robust, production-ready pipeline solutions. Although the initial focus will be on specific projects, the pipelines you will develop should be modular, configurable, and reusable across a growing range of R&D use cases.

What You Will Do
Data Pipeline Engineering
  • Design, build, test, deploy, and maintain robust pipelines for the ingestion, processing, transformation, validation, enrichment, and publication of R&D data and metadata.
  • Deliver solutions supporting the end-to-end data lifecycle, from source-system integration through to FAIR data publication, scientific analysis, and downstream use.
  • Integrate data from internal systems, laboratory applications and instruments, APIs, databases, and file-based sources.
  • Build modular, configurable, and reusable pipelines that can support multiple projects and evolving scientific requirements.
  • Implement appropriate data quality, validation, provenance, traceability, and error-handling controls.
  • Develop supporting APIs, services, workflow components, and data infrastructure where required.
Production Delivery & Engineering Excellence
  • Take solutions from concept and prototype through production deployment, monitoring, troubleshooting, maintenance, and continuous improvement.
  • Apply strong software engineering practices including version control, automated testing, CI/CD, observability, security, documentation, and controlled change management.
  • Optimize pipelines for reliability, scalability, performance, maintainability, and cost efficiency.
  • Contribute hands-on code and help shape technical decisions and engineering approaches.
Collaboration and Innovation
  • Partner with scientists, bioinformaticians, data engineers, architects, data-management specialists, and other stakeholders to translate scientific and business requirements into practical technical solutions.
  • Support appropriate metadata structures, FAIR+T principles, data quality, and data-management standards.
  • Clearly communicate technical options, constraints, and solutions to both technical and non-technical audiences.
  • Coordinate delivery with colleagues and outsourced service provider contractors where required.
  • Identify opportunities to use automation and AI-enabled approaches to improve data-management and engineering workflows.
  • Contribute to technical learning, knowledge sharing, and continuous improvement across the team.
What We Are Looking For
Required Qualifications
  • Strong experience designing, developing, deploying, and maintaining complex data pipelines or data-intensive software solutions.
  • Strong hands-on Python programming skills and familiarity with other relevant programming languages.
  • Practical experience with AWS services such as S3, Lambda, Glue, Step Functions, RDS, CloudWatch, and IAM, or equivalent cloud technologies.
  • Experience with relational databases, APIs, data integration, workflow orchestration, and data-processing frameworks.
  • Proven experience taking pipelines from prototype into production, including deployment, monitoring, troubleshooting, lifecycle management, and continuous improvement.
  • Strong understanding of data quality, validation, error handling, provenance, and traceability.
  • Ability to design modular, reusable, configurable, and maintainable technical solutions.
  • Experience applying software engineering practices including Git/version control, automated testing, CI/CD, observability, documentation, and secure development.
  • Practical knowledge of automation and AI-assisted development for pipeline development, testing, documentation, monitoring, and maintenance.

Ha

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

AstraZeneca plc • Spain

On-site
EUR 90,000 - 120,000
Associate Director, Data Engineer
Associate Director, Data Engineer

AstraZeneca plc • Barcelona

On-site
EUR 90,000 - 150,000
Associate Director Data Engineering
Associate Director Data Engineering

AstraZeneca plc • Barcelona

On-site
EUR 90,000 - 140,000
Senior Data Engineer
Senior Data Engineer

AstraZeneca plc • Barcelona

Hybrid
EUR 85,000 - 110,000
Senior Full Stack Engineer
Senior Full Stack Engineer

AstraZeneca plc • Barcelona

Hybrid
EUR 70,000 - 100,000
Lead AI & Data Engineer - APD Platform
Lead AI & Data Engineer - APD Platform

AstraZeneca plc • Spain

On-site
EUR 90,000 - 120,000
Lead AI & Data Engineer – APD Platform
Lead AI & Data Engineer – APD Platform

AstraZeneca plc • Barcelona

Hybrid
EUR 90,000 - 120,000
Data Pipeline Director (On-Site) - Barcelona
Data Pipeline Director (On-Site) - Barcelona

AstraZeneca plc • Spain

On-site
EUR 120,000 - 170,000
Director Information Architect – Research & Development
Director Information Architect – Research & Development

AstraZeneca • Barcelona

On-site
EUR 140,000 - 190,000
Data Foundation Engineering Lead - Evinova
Data Foundation Engineering Lead - Evinova

Evinova • Barcelona

Hybrid
EUR 120,000 - 180,000