Senior Data Engineer: End-to-End Pipelines on Azure

dsm-firmenich; Cataluña; Vor Ort; EUR 80.000 - 120.000; Vollzeit

Benefits dieser Stelle

Global impact

Sustainability ethos

Career growth

Collaborative culture

Voice and ideas valued

Zusammenfassung

dsm‑firmenich in Barcelona, Spain is seeking an Expert - Data Engineer to own data pipelines from ingestion to the Gold layer, applying modern DevOps and Data Vault 2.0 practices. You will lead CI/CD pipelines, IaC automation, and observability across Azure DevOps and GitHub, collaborating with data scientists, stewards, and business partners to deliver scalable, production-grade data solutions.

You will deploy and manage Databricks workflows, ensure data quality, governance, and FAIR data

Qualifikationen

• Design, build and maintain end-to-end data pipelines across Bronze, Silver and Gold layers.
• Develop data ingestion processes using ETL and API-based methods.
• Create modular transformation frameworks with dbt, PySpark and SQL.

Aufgaben

• Design and implement end-to-end data pipelines for ingestion, transformation, and storage across Bronze, Silver, and Gold layers.
• Develop and manage data ingestion processes from source systems through ETL and API-based extraction methods.
• Build modular transformation frameworks using dbt, PySpark, and SQL, including staging models with load metadata.

Kenntnisse

dbt

SQL

Python

Spark (PySpark)

Databricks

Git

Azure DevOps

GitHub

Tools

Terraform

Bicep

Jobbeschreibung

dsm‑firmenich in Barcelona, Spain is seeking an Expert - Data Engineer to own data pipelines from ingestion to the Gold layer, applying modern DevOps and Data Vault 2.0 practices. You will lead CI/CD pipelines, IaC automation, and observability across Azure DevOps and GitHub, collaborating with data scientists, stewards, and business partners to deliver scalable, production-grade data solutions.

You will deploy and manage Databricks workflows, ensure data quality, governance, and FAIR data