Senior Data Engineer

Michael Bailey Associates; Randstad; Hybrid; EUR 73,000 - 80,000; Full time

Benefits offered by this job

Learning budget

Paid training days

Hardware & tech allowance

Pension plan

Team trips

Lease car option

Job summary

Michael Bailey Associates is seeking a Senior Data Engineer to treat pipelines like production software and build scalable data platforms for major enterprises in aviation, banking, and retail. You’ll join a top consultancy, owning critical systems with high availability and modularity.

You will design and build production-grade ETL/ELT pipelines, create Bronze/Silver/Gold lakehouses on Azure or GCP, and automate infrastructure with Terraform, Docker, Kubernetes, and Airflow.

Qualifications

• 6+ years of software/data engineering experience.
• Proficient in Python, SQL and PySpark.
• Fluent English and strong stakeholder management.

Responsibilities

• Build production-grade ETL/ELT pipelines using Python, PySpark, and SQL with CI/CD and tests.
• Design Medallion Lakehouses (Bronze/Silver/Gold) on Azure or GCP.
• Automate infrastructure and workflows using Terraform/Bicep, Docker, Kubernetes, and Apache Airflow.
• Integrate AI tools & LLMs into pipelines to boost engineering efficiency.
• Translate business logic into robust architecture while safeguarding data lineage.

Skills

Python

SQL

PySpark

Cloud & Lakehouse

DevOps

Airflow

Kafka

dbt

Infrastructure as Code

Stakeholder management

English

Tools

Terraform

Docker

Kubernetes

Apache Airflow

dbt

Git

Job description

We are looking for a Senior Data Engineer who treats pipelines like production software. Someone who builds scalable infrastructure, sets the technical standard, and delivers enterprise-grade data platforms. You’ll join a top consultancy, taking ownership of critical systems for major enterprises in aviation, banking, and retail.

No quick fixes or taped-together scripts, you will build for high availability, modularity, and long-term reliability.

What you'll be doing

• Build production-grade ETL/ELT pipelines using Python, PySpark, and SQL with CI/CD, automated testing, and version control from day one
• Design Medallion Lakehouses (Bronze/Silver/Gold) and dimensional models on Azure or GCP
• Automate & orchestrate infrastructure and workflows using Terraform/Bicep, Docker, Kubernetes, and Apache Airflow
• Integrate AI tools & LLMs into pipelines and workflows to drive measurable engineering efficiency
• Translate business logic into robust architecture while safeguarding data lineage and governance

What you bring

• 6+ years of software/data engineering experience with a code-first mindset (Python, SQL, PySpark)
• Cloud & Lakehouse expertise on Azure (Databricks, Synapse) or GCP (BigQuery, Dataflow)
• Solid DevOps skills with Git, CI/CD, Docker, Kubernetes, and Airflow
• Exposure to modern tooling like Kafka, dbt, or Infrastructure as Code
• Strong stakeholder management and fluent English

What you get

• Salary up to €7150/month, excluding secondary benefits
• Permanent contract (32-40 hours) with hybrid flexibility
• Generous learning budget and paid training days
• Hardware & tech allowance including a high-spec laptop scheme
• Pension plan and regular team trips & social events
• Possibility for a lease car