Senior Data Platform Engineer - Azure Lakehouse & Airflow

Capitole Consulting; Bellprat; On-site; EUR 90,000 - 125,000; Full time

Benefits offered by this job

Professional development stipend

Private health insurance

Meal, transport, childcare vouchers

Wellhub subscription

Capitole Club discounts

Team events

Job summary

Capitole Consulting is seeking a Senior Data Platform Engineer to own the Azure‑based data platform. You will lead Airflow/ADF orchestration, migrate from ADF, and establish a metadata‑driven orchestration framework.

You will manage Azure resources with Terraform, Databricks governance, and observability, while collaborating closely with data product teams. You will drive engineering standards, lead architectural decisions, and mentor other engineers.

Qualifications

• 6+ years of data engineering, with platform or infrastructure focus.
• Strong Python and SQL skills with PySpark and Delta Lake semantics.
• Hands-on Airflow production experience including DAG design and orchestration across Databricks and ADF.
• Experience with Azure resources, IaC, and cost governance.

Responsibilities

• Own and evolve the orchestration platform (Airflow/ADF) including upgrades and DAG standards.
• Migrate from ADF to Airflow and advance the metadata‑driven orchestration framework.
• Manage Azure resources via Terraform and CI/CD pipelines.
• Develop and maintain Databricks Unity Catalog governance and cost optimization.
• Improve observability, monitoring, and incident handling across the platform.

Skills

Python

SQL

PySpark

Data engineering

Observability

Cost optimization

Architecture reviews

Leadership

Tools

Azure Data Platform

Databricks

Airflow

ADF

Terraform

Azure DevOps

Key Vault/Identity mgmt

Unity Catalog

Job description

Capitole Consulting is seeking a Senior Data Platform Engineer to own the Azure‑based data platform. You will lead Airflow/ADF orchestration, migrate from ADF, and establish a metadata‑driven orchestration framework.

You will manage Azure resources with Terraform, Databricks governance, and observability, while collaborating closely with data product teams. You will drive engineering standards, lead architectural decisions, and mentor other engineers.