Senior Data Engineer

MDW; Polska; Hybrid; PLN 180,000 - 260,000; Full time

Benefits offered by this job

25 days paid vacation

Training & certifications budget

Team building events

Job summary

MDW is seeking a Senior Databricks / Spark Data Engineer to join our team and deliver enterprise-scale data solutions. You will own end-to-end data pipelines on Azure and Microsoft Fabric, handling very large data volumes with high performance.

You will work with an international team, collaborate on-site in a hybrid model, and contribute to BI-ready datasets, CI/CD pipelines, and advanced data modelling in Medallion architectures.

Qualifications

• Proven experience delivering Databricks projects at very high data volumes.
• Strong Python and PySpark expertise with Spark performance tuning.
• Hands-on experience with Declarative Automation Bundles and CI/CD pipelines (Azure DevOps).
• End-to-end delivery: data processing to BI-ready datasets.
• Batch Data workflow design, including Medallion Architecture.
• Data Modelling: Star and Snowflake schemas.
• Knowledge of Azure Data Platform: Data Factory, Synapse, Data Lake Gen2, Functions, Logic Apps.

Responsibilities

• Design and deliver enterprise-scale Databricks and Spark data solutions across markets.
• Build and evolve Data Solutions on Azure & Microsoft Fabric.
• Own data pipelines end-to-end, focusing on performance and scalability.
• Deliver consulting projects across industries with evolving requirements.
• Provide client support on-site in a hybrid model and ensure business-aligned solutions.
• Strengthen seniority, autonomy, and delivery confidence within the team.
• Collaborate with an international MDW team to grow together.

Skills

Databricks

Spark

Python

PySpark

Azure DevOps

CI/CD

Data modeling

Data integration

Azure Data Platform

Batch processing

Tools

Azure Data Factory

Azure Synapse

Databricks

Job description

MDW is a leading consulting company specialised in Data, AI and BizApps, with offices in Geneva and Madrid. Recognised as Microsoft Partner of the Year with multiple awards, we help major organisations transform their business with Azure, Microsoft Fabric, Databricks and AI technologies.

Your role

We are looking for a Senior Databricks / Spark Data Engineer to join our team and work on cutting-edge, enterprise-scale Data projects. Given the criticality of the production phase we are entering, we need deep expertise in Databricks and the big data ecosystem, a proven ability to deliver at very high data volumes, and the seniority to tackle complex challenges autonomously and with confidence.

What you will do

• Design and deliver enterprise-scale Databricks and Spark data solutions, handling very high data volumes with parallelised execution across countries and markets
• Build and evolve Data Solutions on Azure & Microsoft Fabric
• Take end-to-end ownership of data pipelines, from data processing to BI-ready datasets, with a strong focus on performance tuning and scalability
• Deliver real consulting projects across industries, reacting quickly to evolving requirements
• Provide personalised support to clients, working closely with them on-site in a hybrid model, ensuring effective collaboration and solutions that align with their business objectives
• Strengthen seniority, autonomy, and delivery confidence within the team
• Collaborate with an international team of experts at MDW to grow together

What we value

Core Requirements – Databricks & Big Data

• Proven experience delivering Databricks projects at very high data volumes, with parallelised execution across countries or markets
• Strong Python and PySpark expertise, with deep knowledge of Spark performance tuning and optimisation
• Hands-on experience with Declarative Automation Bundles and CI/CD pipelines (Azure DevOps)
• Experience with end-to-end delivery: from data processing to BI-ready datasets
• Experience with Batch Data workflow design, including Medallion Architecture
• Experience with Data Modelling: Star schemas, Snowflake schemas
• Knowledge of Azure Data Platform: Data Factory, Synapse, Data Lake Gen2, Azure Functions, Logic Apps, etc.

Infrastructure & DevOps

• Experience with CI/CD with Azure DevOps
• Knowledge of IaC with Terraform, Bicep, ARM, or Pulumi

Soft Skills & Language

• Ability to work with high autonomy and deliver quickly in a fast-paced, evolving project environment
• Strong client communication skills, ensuring effective management and a positive experience throughout the project

Certifications (Valued)

• Databricks certifications (strongly valued)
• Experience working in an Agile environment

Nice to Have

• Real-time workflow design (Kafka, structured streaming, Delta Live Tables, Fabric Eventhouse, etc.)
• Master Data Management & Governance tools (Profisee, Purview)
• Knowledge of Microsoft Fabric platform

What we offer / Our benefits

• Permanent employee contract (Polish payroll)
• Competitive salary based on your experience
• 25 days of paid vacation
• 3 team building events per year
• Dedicated budget for training and certifications
• Ownership across the full lifecycle of cloud-based data solutions