Lead Data Platform Engineer (Databricks, Fabric, Synapse)

iO Associates

Greater London

On-site

GBP 120,000 - 170,000

Full time

7 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

iO Associates is seeking an experienced Lead Data Engineer to drive design, delivery, and evolution of a modern data platform built on Databricks, Microsoft Fabric, Azure Synapse and Azure. This hands-on leadership role guides a team of Data Engineers, sets engineering standards, and delivers scalable, secure, high-performing data solutions.

You’ll lead a high-performing engineering team, act as the technical SME across Databricks, Fabric, Synapse and Azure, own solution design and delivery, and

Qualifications

  • Proven leadership of Data Engineering teams.
  • Strong commercial experience with Databricks, Fabric, or Azure Synapse.
  • Deep expertise in PySpark, Spark SQL, and SQL optimisation.
  • ETL/ELT pipeline development and orchestration.
  • Experience building scalable cloud-based data platforms.

Responsibilities

  • Lead and mentor a high-performing Data Engineering team.
  • Act as the technical SME across Databricks, Fabric, Synapse, and Azure.
  • Own solution design, implementation strategy, and technical delivery.
  • Build and optimise pipelines using PySpark, Spark SQL, or Fabric Pipelines.
  • Define engineering best practice, conduct code reviews, and uplift quality.
  • Develop secure, performant SQL solutions.
  • Manage Azure DevOps Boards, Repos, and CI/CD Pipelines.
  • Collaborate with architects, product owners, and stakeholders.
  • Drive Agile delivery, sprint planning, and continuous improvement.

Skills

Leadership
Databricks
Microsoft Fabric
Azure Synapse
PySpark
Spark SQL
SQL optimisation
ETL/ELT pipelines
Cloud-based data platforms
Azure DevOps / CI/CD

Tools

Azure DevOps
Azure DevOps Boards
CI/CD pipelines

Job description

iO Associates is seeking an experienced Lead Data Engineer to drive design, delivery, and evolution of a modern data platform built on Databricks, Microsoft Fabric, Azure Synapse and Azure. This hands-on leadership role guides a team of Data Engineers, sets engineering standards, and delivers scalable, secure, high-performing data solutions.

You’ll lead a high-performing engineering team, act as the technical SME across Databricks, Fabric, Synapse and Azure, own solution design and delivery, and

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Lead Data Engineer
Lead Data Engineer

iO Associates • Greater London

On-site
GBP 120,000 - 170,000
Senior Data Platform Engineer: Azure Fabric & Databricks
Senior Data Platform Engineer: Azure Fabric & Databricks

Acuity Analytics • Greater London

On-site
GBP 70,000 - 110,000
Lead Data Engineer, Cloud Data Platforms (Fabric/Azure)
Lead Data Engineer, Cloud Data Platforms (Fabric/Azure)

Agilisys • Wigan

Hybrid
GBP 90,000 - 130,000
Enhanced Pension Scheme
Life Assurance
Perks at Work
+1
Senior Data Engineer: Azure Fabric & Data Platform Expert
Senior Data Engineer: Azure Fabric & Data Platform Expert

Acuity Analytics • Bristol

On-site
GBP 70,000 - 110,000
Lead Data Engineer: Azure and Databricks Platform Architect
Lead Data Engineer: Azure and Databricks Platform Architect

IntelliAM AI Ltd • Sheffield

Hybrid
GBP 60,000 - 80,000
Lead Data Platform Engineer — Microsoft Fabric Architect
Lead Data Platform Engineer — Microsoft Fabric Architect

UKund Control • Billericay

Hybrid
GBP 85,000 - 120,000
Competitive salary
Performance bonus
Pension scheme
+4
Senior Data Engineer: Azure Fabric & Data Platform
Senior Data Engineer: Azure Fabric & Data Platform

Ascent Software • United Kingdom

On-site
GBP 70,000 - 100,000
Data Engineer Lead — Azure & Databricks Delivery
Data Engineer Lead — Azure & Databricks Delivery

Simpson Associates • York and North Yorkshire

On-site
GBP 50,000 - 75,000
Senior Data Engineer - Azure/Databricks Platform Lead
Senior Data Engineer - Azure/Databricks Platform Lead

Head Resourcing • Glasgow

On-site
GBP 60,000 - 70,000
Enhanced pension scheme
Life assurance
Enterprise Data Platform Lead & Architect (Azure Fabric)
Enterprise Data Platform Lead & Architect (Azure Fabric)

SF Technology Partners • Warrington

Hybrid
GBP 90,000 - 130,000