Principal Data Engineer

Deloitte - Recruitment

London Borough of Lambeth

On-site

GBP 110,000 - 150,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Deloitte - Recruitment is recruiting a Principal Data Engineer to lead Azure-based data lake solutions, focusing on governance, performance, and scalable design in a high-volume environment. This role emphasizes strategic and technical leadership across Databricks, Unity Catalog, and Delta Live Tables, with hands-on delivery and mentorship of teams to align data initiatives with business goals.

You will collaborate with executives to translate complex data challenges into actionable insights,

Qualifications

  • Bachelor’s or Master’s degree in IT or related field.
  • 15–17+ years in IT with cloud data analytics delivery.
  • Proven data lake architectures and performance optimization.
  • Azure Data Engineering or Databricks certification preferred.
  • Strong Azure knowledge: ADF, ADLS, Databricks, Synapse.
  • Advanced SQL and programming (Python/Scala).

Responsibilities

  • Architect scalable Azure-based data lake solutions.
  • Lead data transformation pipelines with Delta Live Tables and Structured Streaming.
  • Establish capability roadmaps across technologies such as Qlik Replicate, Databricks Delta Live Tables, and Unity Catalog.
  • Mentor and develop a high-performing team.
  • Monitor pipeline performance and resolve issues.
  • Collaborate with cross-functional teams to align project objectives with business goals.
  • Translate technical challenges into actionable insights for executives.

Skills

Leadership
Communication
Stakeholder management
Cloud strategy

Education

Bachelor's or Master's in IT

Tools

Azure Data Factory
Azure Data Lake Storage
Databricks
Delta Live Tables
Unity Catalog
Azure Synapse Analytics
SQL
Python
Scala

Job description

Waterloo, United Kingdom | Posted on 05/11/2026

Deloitte sets therequirements for the assignment. Rockford Resourcing acts as the agency onbehalf of Deloitte and is responsible for sourcing candidates to fulfil theassignment. Successful candidates will be employed by Rockford Payroll.Rockford Payroll is responsible for the Associate’s employment, pay andapplicable employment-related processes.

The Role

We are seeking avisionary Principal Data Engineer to lead the delivery of innovative dataanalytics solutions, with a focus on technical excellence, governance, andoperational performance in a high-volume data environment. This role involvesstrategic and technical leadership in building Azure-based data lake solutions,driving maturity in data management, and engaging with cross-functional teamsto leverage data for organizational success.

Key Responsibilities
  • Architect, design, and implementscalable Azure-based data lake solutions.
  • Establish roadmaps forcapability-building across technologies such as Qlik Replicate, DatabricksDelta Live Tables, and Unity Catalog.
  • Provide technical leadership,ensuring adherence to best practices and quality standards.
  • Lead the development of datatransformation pipelines using Databricks Delta Live Tables and StructuredStreaming.
  • Optimize Databricks resources forhigh-volume data processing without exceeding budget.
  • Oversee the use of Databricks UnityCatalog for data governance, lineage, and metadata management.
  • Develop and enforce robust datagovernance policies, ensuring compliance, security, and data quality.
  • Monitor data pipeline performance andproactively resolve production issues.
  • Collaborate with cross-functionalteams to align project objectives with business goals.
  • Translate technical challenges intoactionable insights for executive teams.
  • Mentor and develop a high-performingteam skilled in Azure, Databricks, and data streaming technologies.
  • Facilitate knowledge transfersessions to empower internal teams with cutting-edge methodologies.
Experience &Skills Required
  • Bachelor’s or Master’s degree in ITor a related discipline.
  • 15-17 years of experience in the ITindustry with expertise in delivering cost-effective cloud-based dataanalytics solutions.
  • Proven track record in building datalake architectures and optimizing performance in big data environments.
  • Certification in Azure DataEngineering or Databricks preferred.
  • Strong knowledge of Azuretechnologies, including ADF, ADLS, Databricks, Stream Analytics, DeltaLive Tables, and Synapse Analytics.
  • Advanced proficiency in SQL andprogramming languages such as Python, Scala, or Spark-SQL.
  • Experience in designing anddeveloping scalable ETL pipelines and optimizing data workflows.
  • Deep understanding of data migrationfrom on-premises to cloud and cloud to cloud.
  • Proven ability to lead diverse teamsand manage end-to-end analytics projects.
  • Exceptional communication andcollaboration skills for engaging executives and stakeholders.
  • Strong sense of ownership,accountability, adaptability, and commitment to results.
  • Expertise in identifying risks andimplementing effective mitigation strategies.
Nice to Have
  • Familiarity with big data tools likeHadoop, Kafka, and Spark.
  • Experience with visualization toolssuch as PowerBI or QlikSense.
  • Knowledge of AI/ML, NLP, and GenAIconcepts.
  • Familiarity with AGILE and KANBANmethodologies.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Data Engineer
Principal Data Engineer

Deloitte - Recruitment • Greater London

On-site
GBP 120,000 - 175,000
Principal Data Engineer
Principal Data Engineer

WRK Digital • Leeds

On-site
GBP 70,000 - 90,000
Senior Data Engineer | DIUK-DIA-SDE-LO-0041
Senior Data Engineer | DIUK-DIA-SDE-LO-0041

Decision Inc. • Greater London

On-site
GBP 70,000 - 110,000
Azure Data Lake Architect & Senior Tech Lead — London
Azure Data Lake Architect & Senior Tech Lead — London

Deloitte - Recruitment • Greater London

On-site
GBP 120,000 - 175,000
Senior Data Engineer
Senior Data Engineer

Advantage Resourcing UK Ltd • Greater London

On-site
GBP 90,000 - 120,000
Data Engineer
Data Engineer

Dufrain • City of Edinburgh, Manchester, Greater London

Hybrid
GBP 45,000 - 65,000
Personal development investment
High performance rewards
Collaborative work culture
Data Engineer
Data Engineer

Talent • Greater London

Hybrid
GBP 90,000 - 120,000
Data Engineer
Data Engineer

Matchtech • West of England

On-site
GBP 60,000 - 90,000
Azure training
Professional development
Modern cloud platforms
+1
Principal Data Engineer
Principal Data Engineer

Nasstar • Greater London

Remote
GBP 100,000 - 150,000
Remote-first
Private health insurance
AWS & Databricks certifications
+1
Data Engineer
Data Engineer

Arrow Global Group • Manchester

On-site
GBP 60,000 - 90,000