Databricks Solution Architect

GIS Recruiter Ltd

City Of London

Sur place

GBP 120 000 - 165 000

Plein temps

Il y a 2 jours
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

GIS Recruiter Ltd in the United Kingdom seeks a Databricks Solution Architect to define and deliver enterprise-scale data platform architectures using Azure Databricks. You will work across architecture design, hands-on engineering and leadership to build secure, scalable data platforms for UK public sector clients.

The role requires deep Databricks expertise, Delta Lake/Lakehouse patterns and Unity Catalog governance, with responsibilities spanning data ingestion, transformation and

Qualifications

  • 5+ years hands-on Databricks platform experience.
  • Extensive Azure Databricks architecture experience.
  • Expert PySpark, Spark SQL and Python knowledge.
  • Deep understanding of Apache Spark processing architecture.
  • Extensive Delta Lake and Lakehouse architecture experience.
  • Experience with Medallion Architecture and Unity Catalog.
  • Knowledge of private endpoints, Key Vault and secure connectivity.
  • Experience with Azure Data Lake Storage Gen2 and Azure services.

Responsabilités

  • Own the end-to-end Databricks solution architecture.
  • Define scalable and secure Lakehouse architecture.
  • Establish engineering and architecture standards.
  • Design data ingestion, transformation and consumption patterns.
  • Define Unity Catalog and enterprise data governance models.
  • Provide technical direction to data engineering teams

Connaissances

Databricks platform
Azure Databricks architecture
PySpark
Spark SQL
Python
Delta Lake
Lakehouse architecture
Medallion Architecture
Unity Catalog
Data governance
Data lineage
Networking

Outils

Azure Databricks
Delta Lake
Unity Catalog
Key Vault
Azure Data Lake Storage Gen2
Azure Data Factory

Description du poste

Consultancy client are looking to recruit a Databricks Solution Architect to define and deliver enterprise-scale data platform architectures using Azure Databricks.

Candidates must possess deep hands-on Databricks engineering knowledge alongside experience designing secure, scalable and highly available data platforms for UK Public Sector organisations. This is a technical architecture role requiring the ability to move between architecture design, technical implementation and engineering leadership.

Essential Technical Skills
  • 5+ years of hands-on Databricks platform experience.
  • Extensive Azure Databricks architecture experience.
  • Expert-level PySpark, Spark SQL and Python knowledge.
  • Deep understanding of Apache Spark processing architecture.
  • Extensive Delta Lake and Lakehouse architecture experience.
  • Strong experience designing Medallion Architecture.
  • Expert knowledge of Unity Catalog, governance, permissions and data lineage.
  • Experience designing Databricks workspaces, clusters, compute policies and networking.
  • Knowledge of private endpoints, managed identities, Key Vault and secure connectivity.
  • Experience with Azure Data Lake Storage Gen2, Azure Data Factory and Azure services.
Public Sector Experience
  • Extensive experience delivering enterprise data architectures
  • Understanding of UK Government security principles and data governance requirements.
  • Experience architecting platforms handling sensitive and restricted government data.
  • Knowledge of UK GDPR, Data Protection Act 2018 and relevant government security standards.
  • Experience producing architecture documentation, HLDs, LLDs and technical design authorities.
  • Experience working with public sector enterprise architecture and governance boards.
Security Clearance Requirements
  • Be eligible and willing to undergo SC clearance
  • Previous experience working on sensitive government projects is advantageous.
Responsibilities
  • Own the end-to-end Databricks solution architecture.
  • Define scalable and secure Lakehouse architecture.
  • Establish engineering and architecture standards.
  • Design data ingestion, transformation and consumption patterns.
  • Define Unity Catalog and enterprise data governance models.
  • Provide technical direction to data engineering teams
Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Databricks Data Engineer
Databricks Data Engineer

GIS Recruiter Ltd • City Of London

Sur place
GBP 90 000 - 130 000
Databricks Solution Architect
Databricks Solution Architect

Undisclosed Company • Greater London

Hybride
GBP 112 000 - 147 000
Data Architect
Data Architect

Brio Digital • Greater London

À distance
GBP 112 000 - 147 000
Data Architect
Data Architect

Brio Digital • Grande-Bretagne

À distance
GBP 112 000 - 147 000
Data Architect
Data Architect

Brio Digital • City Of London

À distance
GBP 112 000 - 147 000
Databricks Platform Engineer
Databricks Platform Engineer

Sagacity Solutions Ltd. • Greater London

Hybride
GBP 85 000 - 120 000
Databricks Data Architect
Databricks Data Architect

Gravitas Recruitment Group • City of Edinburgh, Manchester, Greater London

Hybride
GBP 100 000 - 130 000
Azure Databricks Lakehouse Architect: Governance & Security
Azure Databricks Lakehouse Architect: Governance & Security

GIS Recruiter Ltd • City Of London

Sur place
GBP 120 000 - 165 000
Databricks Architect
Databricks Architect

Project Recruit • Greater London

Hybride
GBP 111 000 - 166 000
Senior Databricks Data Engineer for Public Sector Platform
Senior Databricks Data Engineer for Public Sector Platform

GIS Recruiter Ltd • City Of London

Sur place
GBP 90 000 - 130 000