Azure Data Platform Lead (Databricks)

Capco

Greater London

Hybrid

GBP 110,000 - 150,000

Full time

1 hour ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Discretionary bonus
Pension
Health insurance
Life & critical illness
Gympass
Travel insurance
Tastecard
Cycle to Work
Dental insurance

Job summary

Capco is seeking a Principal Azure Data Engineer (Databricks) to architect and lead enterprise-grade data solutions on the Azure Databricks platform. You will design streaming and batch pipelines, guide architectural decisions, and ensure security, governance, and performance across client deployments.

You'll mentor teams, promote engineering excellence, and partner with clients to define data strategy and governance aligned with business objectives.

Qualifications

  • Experience with Databricks on Azure.
  • Strong data pipeline design skills.
  • Proficient in Python/Java/Scala for data processing.

Responsibilities

  • Own architecture and direction of Databricks-based data platforms on Azure.
  • Design secure, scalable data pipelines using Delta Lake and Spark Streaming.
  • Establish engineering best practices and governance across data platforms.
  • Define technical strategy and governance with clients; balance performance and security.
  • Mentor teams and drive continuous improvement in engineering excellence.

Tools

Python
Java
Scala
Spark
Databricks
Unity Catalog
Delta Lake
Azure DevOps
Jenkins
GitHub Actions
GDPR

Job description

Capco is seeking a Principal Azure Data Engineer (Databricks) to architect and lead enterprise-grade data solutions on the Azure Databricks platform. You will design streaming and batch pipelines, guide architectural decisions, and ensure security, governance, and performance across client deployments.

You'll mentor teams, promote engineering excellence, and partner with clients to define data strategy and governance aligned with business objectives.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Architect — Senior Cloud Data Leader
Azure Databricks Architect — Senior Cloud Data Leader

Sogeti • Greater London

Hybrid
GBP 90,000 - 130,000
Senior Azure Data Engineer (Databricks) - Real-Time Pipelines
Senior Azure Data Engineer (Databricks) - Real-Time Pipelines

Capco • City of Edinburgh

Hybrid
GBP 70,000 - 100,000
Discretionary bonus
Health insurance
Pension
+3
Senior Azure Data Engineer (Databricks) – Real-Time Pipelines
Senior Azure Data Engineer (Databricks) – Real-Time Pipelines

Capco • Glasgow

Hybrid
GBP 90,000 - 120,000
Discretionary bonus
Pension
Health insurance
+3
London Hybrid Senior Azure Data Engineer - Databricks
London Hybrid Senior Azure Data Engineer - Databricks

Capco • Greater London

Hybrid
GBP 90,000 - 120,000
Discretionary bonus
Health insurance
Life insurance
+2
Azure Databricks Lead Engineer | Data & Platform Ops
Azure Databricks Lead Engineer | Data & Platform Ops

Sogeti • United Kingdom

Hybrid
GBP 70,000 - 110,000
Azure Databricks Platform Architect
Azure Databricks Platform Architect

Sogeti • United Kingdom

Hybrid
GBP 90,000 - 130,000
Hybrid work model
Training & development opportunities
Azure Databricks Solution Architect Data Platform Leader
Azure Databricks Solution Architect Data Platform Leader

Test Triangle Limited • United Kingdom

On-site
GBP 90,000 - 125,000
Cloud Data Architecture Lead – Databricks & Analytics
Cloud Data Architecture Lead – Databricks & Analytics

401 Protiviti Limited • Greater London

Hybrid
GBP 90,000 - 140,000
Medical insurance
Dental insurance
Pension scheme
+2
Azure Databricks Data Engineer: ETL & Data Lake Architect
Azure Databricks Data Engineer: ETL & Data Lake Architect

Capgemini • Greater London

Hybrid
GBP 80,000 - 110,000
Head of Data Engineering — Azure Databricks Platform Lead
Head of Data Engineering — Azure Databricks Platform Lead

Secure Trust Bank Group • Metropolitan Borough of Solihull

On-site
GBP 90,000 - 140,000
Discretionary bonus
Matched pension
Birthday off