Principal Data Engineer & Tech Lead (Azure + Databricks)

KPMG LLP; Greater London; On-site; GBP 120,000 - 150,000; Full time

Job summary

KPMG in the UK is seeking a Senior Manager - Principal Data Engineer to shape data engineering strategy and lead a high-performing team within Clara Technology & Solutions. The role focuses on Databricks, Azure cloud, and enterprise-scale data delivery.

Responsibilities include designing scalable data pipelines, governance, integration with BI tools, and promoting modern software engineering practices across the function. UK-wide impact with permanent, on-site work in London.

Qualifications

• Hands-on Databricks experience with PySpark, Delta Lake and Unity Catalog governance.
• Designs advanced data models, medallion architectures, data lakes and enterprise data warehouses.
• Expert SQL and Python for data engineering and analytics workloads.
• Cloud engineering with a strong Azure preference and data governance focus.

Responsibilities

• Lead data engineering initiatives and deliver enterprise-scale cloud data solutions.
• Define technical roadmaps and govern data platform standards and quality gates.
• Mentor engineers, promote Agile and DevOps practices, and manage stakeholder alignment.
• Collaborate with BI tools (Power BI) and AI-assisted development to enable self-service analytics.

Skills

Databricks

PySpark

Delta Lake

Unity Catalog

SQL

Python

Azure

Databricks Workflows

CI/CD

Git/GitHub

Agile/Scrum/Kanban

DevOps

RBAC/Data governance

Kafka/Kinesis/Event Hubs

IaC Terraform/Azure Bicep

Education

Bachelor's degree in Computer Science, Data Science, Engineering, or related technical discipline

Tools

Databricks

Azure Data Factory

Delta Live Tables

Power BI

Microsoft Azure

GitHub

Terraform

Azure Bicep

Job description

KPMG in the UK is seeking a Senior Manager - Principal Data Engineer to shape data engineering strategy and lead a high-performing team within Clara Technology & Solutions. The role focuses on Databricks, Azure cloud, and enterprise-scale data delivery.

Responsibilities include designing scalable data pipelines, governance, integration with BI tools, and promoting modern software engineering practices across the function. UK-wide impact with permanent, on-site work in London.