Senior Data Engineer – Pipelines, Databricks & DevOps

dsm-firmenich; Barcelona; On-site; EUR 90,000 - 130,000; Full time

Job summary

dsm-firmenich is seeking an Expert - Data Engineer to design and maintain robust data pipelines across Bronze, Silver, and Gold layers, applying modern DevOps practices with Azure DevOps and GitHub.

You will own data products from source ingestion to semantic models, leverage dbt, PySpark, Databricks, and CI/CD automation, and collaborate with data modelers, stewards, and business partners to deliver production-grade solutions.

Qualifications

• 5+ years of experience building production-grade data pipelines.
• Deep knowledge of dbt, SQL, Python, Spark (PySpark), and Databricks.
• Strong CI/CD automation using Azure DevOps and GitHub Actions.
• Experience with Infrastructure-as-Code (Terraform, Bicep).
• Knowledge of Data Vault 2.0 architectures.
• Experience deploying Databricks jobs and managing clusters.
• Excellent collaboration across cross-functional teams.
• Experience with data governance and quality practices.

Responsibilities

• Design and maintain end-to-end data pipelines across Bronze, Silver, and Gold layers.
• Build modular data transformations using dbt, PySpark, and SQL.
• Develop CI/CD and IaC pipelines in Azure DevOps and GitHub Actions.
• Manage IaC for data platforms including environments and deployments.
• Establish observability and incident response practices.
• Drive data governance, quality, and lineage across platforms.
• Provide technical leadership and mentor data engineering teams.

Skills

dbt

SQL

Python

Spark (PySpark)

Databricks

Git

Azure DevOps

GitHub

Data Vault 2.0

Terraform

Bicep

Education

Tools

Terraform

Bicep

Job description

dsm-firmenich is seeking an Expert - Data Engineer to design and maintain robust data pipelines across Bronze, Silver, and Gold layers, applying modern DevOps practices with Azure DevOps and GitHub.

You will own data products from source ingestion to semantic models, leverage dbt, PySpark, Databricks, and CI/CD automation, and collaborate with data modelers, stewards, and business partners to deliver production-grade solutions.