Senior Data Engineer

3pX Group ★ A Sunday Times Best Place to Work; Deutschland; On-site; EUR 90,000 - 120,000; Full time

Job summary

3pX Group is seeking an experienced Senior Data Engineer to join its Data & Analytics team in Germany. You’ll design and optimise a modern Azure Data Platform using Databricks, PySpark and scalable data pipelines.

You’ll build CI/CD pipelines for data workloads, support governance and security, and collaborate with BI teams on data models and reporting solutions. This is a hands-on role with opportunities to influence architecture and tooling decisions.

Qualifications

• Extensive experience with Databricks and Spark-based data processing.
• Proficient in PySpark for building scalable ETL/ELT pipelines.
• Experience implementing CI/CD for data workloads and Databricks deployments.

Responsibilities

• Design and develop modern Azure data platforms (Azure Data Factory, ADLS Gen2, Databricks, Synapse).
• Build scalable ETL/ELT pipelines using PySpark/Spark.
• Develop and maintain CI/CD pipelines for data workloads and Databricks.
• Support multi-environment data platforms (dev/test/prod).
• Optimise Azure infrastructure for performance and cost.
• Collaborate with BI and data teams on data models and reporting.

Skills

Databricks

PySpark

Spark

CI/CD

Deployment automation

Tools

Azure Data Factory

ADLS Gen2

Azure Synapse

Job description

I’m currently working with an established international business that is looking for an experienced Senior Data Engineer to join their growing Data & Analytics team.

This is a hands‑on position where you’ll play a key role in developing and optimising a modern Azure Data Platform, with a strong focus on Databricks, PySpark and scalable data engineering.

What you’ll be working on:

• Designing and developing modern Azure data platforms using Azure Data Factory, ADLS Gen2, Databricks and Azure Synapse
• Building scalable ETL/ELT pipelines using PySpark and Spark
• Developing and maintaining CI/CD pipelines for data and Databricks workloads
• Supporting multi‑environment data platforms across development, test and production
• Optimising Azure infrastructure for performance, scalability and cost
• Working closely with BI and Data teams on data models and reporting solutions
• Supporting data governance, security and access management

What we’re looking for:

• Very good Databricks experience
• Strong PySpark and Spark knowledge
• CI/CD and deployment automation experience
• Experience with Parquet and/or Avro
• Fluent English, German would be an advantage