Tech Lead: Azure Databricks Data Platform

Aubay UK; Greater London; On-site; GBP 90,000 - 140,000; Full time

Job summary

Aubay UK is seeking an experienced Tech Lead to guide the design, development, and delivery of enterprise-scale data platform solutions on the Azure Databricks ecosystem. The role requires deep hands-on expertise and strong leadership to drive platform strategy and delivery excellence.

The ideal candidate will mentor engineering teams, optimise platform performance and costs, and collaborate with stakeholders across business, architecture, and product teams to translate complex requirements into

Qualifications

• Strong hands-on experience with Azure Databricks, PySpark, Python and SQL.
• Experience delivering enterprise-scale data platforms on Microsoft Azure.
• Proven track record in leading technical delivery from design through production support.
• Understanding of data governance, quality, and engineering best practices.

Responsibilities

• Lead the design, development, and implementation of scalable data platform solutions using Azure and Databricks.
• Provide technical leadership across the full solution lifecycle, from architecture through delivery and production support.
• Define and promote best practices for data engineering, governance, security, quality, and platform standards.
• Mentor Data Engineers and drive delivery excellence across teams.
• Collaborate with stakeholders to translate business requirements into technical solutions and align with platform strategy.

Skills

Leadership & mentorship

Stakeholder management

Solution architecture

Data platform governance

Delivery leadership

Tools

Azure Databricks

PySpark

Python

SQL

Structured Streaming

Delta Live Tables (DLT)

Job description

Aubay UK is seeking an experienced Tech Lead to guide the design, development, and delivery of enterprise-scale data platform solutions on the Azure Databricks ecosystem. The role requires deep hands-on expertise and strong leadership to drive platform strategy and delivery excellence.

The ideal candidate will mentor engineering teams, optimise platform performance and costs, and collaborate with stakeholders across business, architecture, and product teams to translate complex requirements into