Azure Databricks Lead Engineer | Data & Platform Ops

Sogeti

United Kingdom

Hybrid

GBP 70,000 - 110,000

Full time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Capgemini is seeking an Azure Databricks Engineer to join our ACT Practice in the UK, delivering value through modern data engineering and cloud-native platforms. The role blends work across client sites, offices, and home in a hybrid model, with emphasis on Azure Databricks, Python, PySpark, and SQL in production environments.

The successful candidate will collaborate with data engineers, data scientists and platform teams, focusing on serverless Databricks, Delta Lake, and cost optimization

Qualifications

  • Hands-on experience with Azure Databricks in production
  • Strong Python, PySpark and SQL development
  • Experience designing data ingestion and transformation pipelines
  • Knowledge of CDC and data quality controls
  • REST API integration experience
  • Experience with Azure IAM, networking, and security

Responsibilities

  • Support production Azure Databricks environments and troubleshoot performance
  • Collaborate with Data Engineers, Data Scientists, and Platform Teams
  • Implement cost monitoring and resource tagging
  • Support migration and BI tooling integration
  • Provide agile delivery and knowledge transfer

Skills

Azure Databricks
Databricks SQL
Delta Lake
Python
PySpark
SQL
REST API
ETL pipelines
CDC
Data quality
BI tooling
Azure IAM
Azure Networking
Azure Key Vault
Azure Monitoring
Cost optimization
Agile delivery
Documentation
Collaboration

Job description

Capgemini is seeking an Azure Databricks Engineer to join our ACT Practice in the UK, delivering value through modern data engineering and cloud-native platforms. The role blends work across client sites, offices, and home in a hybrid model, with emphasis on Azure Databricks, Python, PySpark, and SQL in production environments.

The successful candidate will collaborate with data engineers, data scientists and platform teams, focusing on serverless Databricks, Delta Lake, and cost optimization

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Engineer — Hybrid Data Solutions
Azure Databricks Engineer — Hybrid Data Solutions

Capgemini • Greater London

Hybrid
GBP 70,000 - 110,000
Azure Databricks Architect — Senior Cloud Data Leader
Azure Databricks Architect — Senior Cloud Data Leader

Sogeti • Greater London

Hybrid
GBP 90,000 - 130,000
Azure Databricks Tech Lead – Platform Engineering
Azure Databricks Tech Lead – Platform Engineering

Sogeti • Manchester

Hybrid
GBP 70,000 - 120,000
Hybrid working
Career development
Azure Databricks Lead Data Engineer | Data Ops
Azure Databricks Lead Data Engineer | Data Ops

Tata Consultancy Services Limited • Redditch

Hybrid
GBP 80,000 - 110,000
Pension
Health care
Life assurance
+3
Hybrid Azure Databricks Lead Architect
Hybrid Azure Databricks Lead Architect

EPAM Systems Inc • Greater London

Hybrid
GBP 110,000 - 150,000
EPAM Employee Stock Purchase Plan (ES?
Life assurance
Income protection
+16
Senior Azure Databricks Architect — Hybrid London
Senior Azure Databricks Architect — Hybrid London

EPAM Systems Ltd • Greater London

Hybrid
GBP 110,000 - 150,000
ESPP
Private medical
Dental care
+11
Azure Databricks Engineer for Data Pipelines & Lakes
Azure Databricks Engineer for Data Pipelines & Lakes

Capgemini • Greater London

Hybrid
GBP 70,000 - 100,000
Disability Confident Employer (Level 2
Lead Azure Databricks Architect for Real-Time Data (Hybrid)
Lead Azure Databricks Architect for Real-Time Data (Hybrid)

EPAM Systems Inc • City of Westminster

Hybrid
GBP 120,000 - 150,000
ESPP
Private medical insurance
Dental care
+4
Senior Azure Data Engineer (Databricks) – Real-Time Pipelines
Senior Azure Data Engineer (Databricks) – Real-Time Pipelines

Capco • Glasgow

Hybrid
GBP 90,000 - 120,000
Discretionary bonus
Pension
Health insurance
+3
Senior Azure Data Engineer (Databricks) - Real-Time Pipelines
Senior Azure Data Engineer (Databricks) - Real-Time Pipelines

Capco • City of Edinburgh

Hybrid
GBP 70,000 - 100,000
Discretionary bonus
Health insurance
Pension
+3