Senior Data Engineer

Databricks, Inc.; Langley; Hybrid; GBP 85,000 - 100,000; Full time

Benefits offered by this job

Bonus 10%

Job summary

Databricks, Inc. is seeking a Senior Data Engineer to join its Enterprise Data function in a hybrid London/Slough setting.

The role focuses on delivering complex data engineering work on Azure Databricks and leading other engineers while maintaining hands-on technical leadership. You will design scalable data solutions, build batch and streaming pipelines, and develop trusted datasets for reporting, analytics and AI, using Python, PySpark, Delta Lake and SQL.

Qualifications

• 5–7 years of data engineering experience.
• Strong and current Azure Databricks experience.
• Advanced Python, PySpark and SQL skills.
• Strong knowledge of Delta Lake, Unity Catalog and data modelling.
• Experience with Azure Data Factory and Azure Data Lake Storage.
• Experience of infrastructure as code and Azure resource management.
• A strong understanding of software engineering principles, automated testing and CI/CD.
• Recent experience leading or mentoring Data Engineers.
• The ability to review and assure the quality of other engineers' work.
• An interest in architecture and the ambition to take on broader technical responsibility.

Responsibilities

• Deliver complex data engineering work.
• Provide day-to-day technical leadership to other engineers.
• Act as the number-two technologist within the Enterprise Data team.
• Design and build scalable data solutions using Azure and Databricks.
• Develop batch and streaming data pipelines from databases, APIs and Kafka.
• Build trusted datasets for reporting, analytics and AI.
• Work with Python, PySpark, Delta Lake, Unity Catalog and SQL.
• Develop dimensional data models using Kimball principles.
• Review code, technical designs, Terraform and testing.
• Ensure the team's engineering work meets quality and governance standards.
• Support Data Engineers with technical decisions and complex problems.
• Contribute to architecture and wider technical direction of the data function.
• Improve CI/CD, automated testing, monitoring and platform reliability.

Skills

Azure Databricks

Python

PySpark

SQL

Delta Lake

Unity Catalog

Terraform

CI/CD

Data modeling

Architecture leadership

Tools

Azure Data Factory

Azure Data Lake Storage

Terraform

Job description

Senior Data Engineer

Location: Slough, Berkshire, GB, SL1 1

Contract Date: 2026-09-26

Updated: 2026-10-24T10:14:34.173

Job Description

London - hybrid working
£85,000-£100,000 plus 10% bonus

My client is looking for a Senior Data Engineer to join its Enterprise Data function. This is a senior, hands-on role for someone who is technically excellent but also comfortable leading other engineers and taking responsibility for the quality of the team's work.

The data platform is built in Azure, with Databricks at its core. My client therefore needs someone with strong, recent Databricks experience rather than someone who has only used it briefly or several years ago.

The successful candidate will have three main responsibilities: delivering complex data engineering work, providing day-to-day technical leadership to other engineers, and acting as the number-two technologist within the Enterprise Data team. The role will focus on:

• Designing and building scalable data solutions using Azure and Databricks
• Developing batch and streaming data pipelines from databases, APIs and Kafka
• Building trusted datasets for reporting, analytics, data science and AI
• Working with Python, PySpark, Delta Lake, Unity Catalog and SQL
• Developing dimensional data models using Kimball principles
• Reviewing code, technical designs, Terraform and testing
• Ensuring the team's engineering work meets the required quality and governance standards
• Supporting Data Engineers with technical decisions and complex problems
• Contributing to the architecture and wider technical direction of the data function
• Improving CI/CD, automated testing, monitoring and platform reliability

Candidate Profile

The role would suit someone with:

• At least five to seven years' experience in data engineering
• Strong and current Azure Databricks experience
• Advanced Python, PySpark and SQL skills
• Strong knowledge of Delta Lake, Unity Catalog and data modelling
• Experience with Azure Data Factory and Azure Data Lake Storage
• Experience of infrastructure as code and Azure resource management
• A strong understanding of software engineering principles, automated testing and CI/CD
• Recent experience leading or mentoring Data Engineers
• The ability to review and assure the quality of other engineers' work
• An interest in architecture and the ambition to take on broader technical responsibility

This is not a traditional management role and the successful candidate will remain highly hands-on. However, they will need to be capable of leading by example, setting technical standards and helping develop the engineers around them.

Experience with Function Apps, Logic Apps, streaming technologies, Purview, Power BI or AI would be useful but is not essential. Please get in touch if you would like to discuss the role in more detail.

Please note - this role cannot offer sponsorship. Please only apply if you have full UK working rights.