Data Engineering Lead — Azure & Data Platforms

Metyis; Amsterdam; Hybrid; EUR 90,000 - 150,000; Full time

Job summary

Adaptfy is seeking a senior data engineering leader to drive the technical roadmap for client data platforms and analytics products. You will oversee architecture, ensure alignment with business needs, and guide development using Python, Spark, REST APIs and Microsoft Azure.

You will coach a small team, deliver data pipelines, dashboards, and data products in collaboration with the data science team, while maintaining high engineering standards and governance.

Qualifications

• 5-7 years of experience in a similar role with experience in developing and deploying ETL solutions on Azure.
• Solid knowledge of data warehousing principles, concepts, and best practices (ODS, data marts, data lakes, data vault, 3NF).
• Good understanding of cloud-based development; CI/CD workflows and GitHub or similar.
• Experience in setting up automated testing frameworks including unit tests and integration tests.
• Understanding of modern cloud-based architecture (Lambda & Kappa).
• Advanced SQL, data transformation, and data profiling skills.
• Experience building production ETL/ELT pipelines at scale.
• Data governance experience.

Responsibilities

• Lead the technical roadmap for client data platforms and analytics products.
• Oversee architecture to ensure components align with customer needs.
• Develop digital development and operations using Python, Spark, RESTful APIs, and Azure Cloud.
• Drive engineering excellence with industry standards and best practices.
• Coach team members to deliver high-quality data products and dashboards.
• Deliver data platforms and insights in collaboration with the data science team.

Skills

Python

Azure

Spark

ETL

Data warehousing

REST APIs

CI/CD

Airflow

Kubernetes

Power BI

Education

Bachelor's Degree in Computer Science / Math / Engineering

Master's Degree is a plus

Tools

Azure Data Factory

Databricks

Synapse

Power BI

Airflow

Kubernetes

Job description

Adaptfy is seeking a senior data engineering leader to drive the technical roadmap for client data platforms and analytics products. You will oversee architecture, ensure alignment with business needs, and guide development using Python, Spark, REST APIs and Microsoft Azure.

You will coach a small team, deliver data pipelines, dashboards, and data products in collaboration with the data science team, while maintaining high engineering standards and governance.