Senior Data Engineer — Hybrid, Production-Grade Pipelines

Michael Bailey Associates; Randstad; Hybrid; EUR 73,000 - 87,000; Full time

Benefits offered by this job

Lease car

Generous learning budget

Job summary

Michael Bailey Associates seeks a Senior Data Engineer to treat pipelines like production software and build scalable, enterprise-grade data platforms. You will own critical systems for aviation, banking, and retail with a code-first mindset.

You will design production-grade ETL/ELT pipelines, medallion lakehouses, and automated, observable data stacks on Azure or GCP, using Terraform, Docker, Kubernetes, and Airflow, plus integrate AI tools to boost efficiency.

Qualifications

• 6+ years of software/data engineering experience.
• Proficient in Python, SQL, and PySpark.
• Cloud & Lakehouse expertise on Azure Databricks/Synapse or GCP BigQuery/Dataflow.
• Solid DevOps skills with Git, CI/CD, Docker, Kubernetes, and Airflow.
• Exposure to modern tooling like Kafka, dbt, or Infrastructure as Code.
• Strong stakeholder management and fluent English.

Responsibilities

• Build production-grade ETL/ELT pipelines using Python, PySpark, and SQL with CI/CD, automated testing, and version control from day one.
• Design Medallion Lakehouses (Bronze/Silver/Gold) and dimensional models on Azure or GCP.
• Automate & orchestrate infrastructure and workflows using Terraform/Bicep, Docker, Kubernetes, and Apache Airflow.
• Integrate AI tools & LLMs into pipelines and workflows to drive measurable engineering efficiency.
• Translate business logic into robust architecture while safeguarding data lineage and governance.

Skills

Python

SQL

PySpark

Cloud & Lakehouse

DevOps

Kubernetes

Airflow

Stakeholder management

English fluency

Tools

Git

CI/CD

Docker

Kubernetes

Airflow

Kafka

dbt

Infrastructure as Code

Job description

Michael Bailey Associates seeks a Senior Data Engineer to treat pipelines like production software and build scalable, enterprise-grade data platforms. You will own critical systems for aviation, banking, and retail with a code-first mindset.

You will design production-grade ETL/ELT pipelines, medallion lakehouses, and automated, observable data stacks on Azure or GCP, using Terraform, Docker, Kubernetes, and Airflow, plus integrate AI tools to boost efficiency.