Senior Data Engineer

Michael Bailey Associates; Randstad; Hybrid; EUR 73,000 - 87,000; Full time

Benefits offered by this job

Lease car

Generous learning budget

Job summary

Michael Bailey Associates seeks a Senior Data Engineer to treat pipelines like production software and build scalable, enterprise-grade data platforms. You will own critical systems for aviation, banking, and retail with a code-first mindset.

You will design production-grade ETL/ELT pipelines, medallion lakehouses, and automated, observable data stacks on Azure or GCP, using Terraform, Docker, Kubernetes, and Airflow, plus integrate AI tools to boost efficiency.

Qualifications

• 6+ years of software/data engineering experience.
• Proficient in Python, SQL, and PySpark.
• Cloud & Lakehouse expertise on Azure Databricks/Synapse or GCP BigQuery/Dataflow.
• Solid DevOps skills with Git, CI/CD, Docker, Kubernetes, and Airflow.
• Exposure to modern tooling like Kafka, dbt, or Infrastructure as Code.
• Strong stakeholder management and fluent English.

Responsibilities

• Build production-grade ETL/ELT pipelines using Python, PySpark, and SQL with CI/CD, automated testing, and version control from day one.
• Design Medallion Lakehouses (Bronze/Silver/Gold) and dimensional models on Azure or GCP.
• Automate & orchestrate infrastructure and workflows using Terraform/Bicep, Docker, Kubernetes, and Apache Airflow.
• Integrate AI tools & LLMs into pipelines and workflows to drive measurable engineering efficiency.
• Translate business logic into robust architecture while safeguarding data lineage and governance.

Skills

Python

SQL

PySpark

Cloud & Lakehouse

DevOps

Kubernetes

Airflow

Stakeholder management

English fluency

Tools

Git

CI/CD

Docker

Kubernetes

Airflow

Kafka

dbt

Infrastructure as Code

Job description

We are looking for a Senior Data Engineer who treats pipelines like production software. Someone who builds scalable infrastructure, sets the technical standard, and delivers enterprise-grade data platforms. You’ll join a top consultancy, taking ownership of critical systems for major enterprises in aviation, banking, and retail.

No quick fixes or taped-together scripts, you will build for high availability, modularity, and long-term reliability.

What you'll be doing

• Build production-grade ETL/ELT pipelines using Python, PySpark, and SQL with CI/CD, automated testing, and version control from day one
• Design Medallion Lakehouses (Bronze/Silver/Gold) and dimensional models on Azure or GCP
• Automate & orchestrate infrastructure and workflows using Terraform/Bicep, Docker, Kubernetes, and Apache Airflow
• Integrate AI tools & LLMs into pipelines and workflows to drive measurable engineering efficiency
• Translate business logic into robust architecture while safeguarding data lineage and governance

What you bring

• 6+ years of software/data engineering experience with a code-first mindset (Python, SQL, PySpark)
• Cloud & Lakehouse expertise on Azure (Databricks, Synapse) or GCP (BigQuery, Dataflow)
• Solid DevOps skills with Git, CI/CD, Docker, Kubernetes, and Airflow
• Exposure to modern tooling like Kafka, dbt, or Infrastructure as Code
• Strong stakeholder management and fluent English

What you get

• Salary up to €7150/month, excluding secondary benefits
• Permanent contract (32–40 hours) with hybrid flexibility
• Generous learning budget and paid training days
• Hardware & tech allowance including a high-spec laptop scheme
• Pension plan and regular team trips & social events
• Possibility for a lease car

Feel free to apply even if you don't tick all the boxes.