Senior Databricks Data Engineer for Public Sector Platform

GIS Recruiter Ltd

City Of London

Sur place

GBP 90 000 - 130 000

Plein temps

Il y a 2 jours
Soyez parmi les premiers à postuler

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

GIS Recruiter Ltd is seeking an experienced Senior Databricks Data Engineer to design and implement enterprise-scale data platforms using Azure Databricks for UK public sector clients. You will deliver complex ETL/ELT pipelines, Delta Lake solutions and Lakehouse architectures with strong governance.

Ideal candidates have 5+ years hands-on Databricks experience, expert PySpark and Spark SQL skills, and familiarity with Medallion Architecture, ADF integration, and data security standards.

Qualifications

  • 5+ years hands-on Databricks experience in enterprise data platforms.
  • Expert-level Azure Databricks and PySpark proficiency required.
  • Strong SQL skills and data modeling capabilities.
  • Experience with Delta Lake, Delta Live Tables and Lakehouse concepts.
  • Familiarity with Medallion Architecture and governance controls.
  • CI/CD tooling experience and automated deployments.
  • Public sector or government data security knowledge is a plus.

Responsabilités

  • Design and develop scalable Databricks data pipelines.
  • Build enterprise-grade Lakehouse platforms compliant with security standards.
  • Optimize Spark workloads and manage Databricks clusters.
  • Implement data quality, governance and validation frameworks.
  • Collaborate with architects, analysts and stakeholders across teams.
  • Support production deployments and troubleshoot data issues.
  • Ensure solutions align with UK public sector requirements.

Connaissances

Databricks
Azure Databricks
PySpark
Spark SQL
Python
ETL/ELT pipelines
Delta Lake
Delta Live Tables
Lakehouse architecture
Medallion Architecture
Spark performance tuning
Unity Catalog & data governance
CDC & SCD approaches
SQL development
Azure Data Factory integration
ADLS Gen2
CI/CD (Git, Azure DevOps)
Data quality frameworks

Description du poste

GIS Recruiter Ltd is seeking an experienced Senior Databricks Data Engineer to design and implement enterprise-scale data platforms using Azure Databricks for UK public sector clients. You will deliver complex ETL/ELT pipelines, Delta Lake solutions and Lakehouse architectures with strong governance.

Ideal candidates have 5+ years hands-on Databricks experience, expert PySpark and Spark SQL skills, and familiarity with Medallion Architecture, ADF integration, and data security standards.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Databricks Data Engineer
Databricks Data Engineer

GIS Recruiter Ltd • City Of London

Sur place
GBP 90 000 - 130 000
Databricks Solution Architect
Databricks Solution Architect

GIS Recruiter Ltd • City Of London

Sur place
GBP 120 000 - 165 000
Azure Databricks Lakehouse Architect: Governance & Security
Azure Databricks Lakehouse Architect: Governance & Security

GIS Recruiter Ltd • City Of London

Sur place
GBP 120 000 - 165 000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

ISx4 Group • Belfast City District

Hybride
GBP 70 000 - 100 000
Senior Data Platform Engineer - Azure Databricks Lakehouse
Senior Data Platform Engineer - Azure Databricks Lakehouse

Source Group International • Greater London

Sur place
GBP 90 000 - 125 000
Senior Data Engineer
Senior Data Engineer

Ceox • Grande-Bretagne

À distance
GBP 83 000 - 131 000
Senior Data Engineer - Azure & Databricks Platform
Senior Data Engineer - Azure & Databricks Platform

Ceox Services Ltd • Grande-Bretagne

À distance
GBP 50 000 - 70 000
Remote working option
Senior Databricks Engineer (Contract, £550-600 p/d)
Senior Databricks Engineer (Contract, £550-600 p/d)

Layke AI • Birmingham

Hybride
GBP 60 000 - 80 000
Senior Data Engineer — Azure, Databricks & Lakehouse
Senior Data Engineer — Azure, Databricks & Lakehouse

DCG (Poland) • Grande-Bretagne

À distance
GBP 80 000 - 120 000
Private medical care
Co-financing for the sports card
Dedicated consultant support
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Tenth Revolution Group • Grande-Bretagne

À distance
GBP 90 000 - 130 000