Lead Data Engineer – Azure, Databricks & CI/CD

dsm-firmenich; Barcelona; Presencial; EUR 90.000 - 120.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Career growth opportunities

Global impact on health & nutrition

Science‑led culture

Professional development and learning

Collaborative cross‑functional teams

Descripción de la vacante

dsm-firmenich is seeking a Lead Data Engineer in Barcelona to design and maintain robust data pipelines across Bronze to Gold layers, and own the full lifecycle of data products. You will work with dbt, Databricks, PySpark, and CI/CD automation while enabling scalable, production-grade solutions in a global environment.

You will collaborate with data modelers, stewards, and business partners to deliver high‑impact data solutions, advance governance, and implement modern DevOps practices across

Formación

• 5+ years of production‑grade data pipeline experience.
• Experience with data vault architectures and cloud data platforms.

Responsabilidades

• Design and implement end-to-end data pipelines for ingestion, transformation, and storage across Bronze, Silver, and Gold layers.
• Develop and manage data ingestion processes from source systems via ETL and API‑based methods.
• Build modular transformation frameworks using dbt, PySpark, and SQL with proper metadata.
• Design, build, and maintain CI/CD and DevOps processes in Azure DevOps and GitHub Actions.
• Implement IaC for data platform resources and deployment automation.
• Establish monitoring, observability, and operational excellence for platform reliability.
• Drive data quality, governance, and FAIR principles with automated testing and lineage management.
• Provide technical leadership and cross‑functional collaboration across teams.

Conocimientos

dbt

SQL

Python

Spark/PySpark

Databricks

Git

Azure DevOps

GitHub

CI/CD automation

Data Vault 2.0

Herramientas

Terraform

Bicep

Descripción del empleo

dsm-firmenich is seeking a Lead Data Engineer in Barcelona to design and maintain robust data pipelines across Bronze to Gold layers, and own the full lifecycle of data products. You will work with dbt, Databricks, PySpark, and CI/CD automation while enabling scalable, production-grade solutions in a global environment.

You will collaborate with data modelers, stewards, and business partners to deliver high‑impact data solutions, advance governance, and implement modern DevOps practices across