Enterprise Databricks Lakehouse Architect

Vallum Associates

Greater London

Vor Ort

GBP 90.000 - 130.000

Vollzeit

vor 34 Stunden
Sei unter den ersten Bewerbenden

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Vallum Associates is seeking a Senior Databricks Platform Engineer to design, build, and operate enterprise Databricks Lakehouse platforms for banking and financial services clients. You will provision workspaces, implement CI/CD, and enforce security controls across multiple environments and regions.

Responsibilities include configuring Unity Catalog, RBAC, and secrets management; automating IaC with Terraform; and integrating Databricks with AWS services.

Qualifikationen

  • Hands-on Databricks Lakehouse experience across notebooks, jobs, and workflows.
  • Experience with Unity Catalog and autoloader/structured streaming.
  • Experience with AWS services (S3, IAM, KMS) and Glue/Lambda; data migrations to Databricks.
  • Terraform or IaC for Databricks configuration; batch and incremental pipelines.

Aufgaben

  • Build, secure, automate, and run Databricks Lakehouse platforms across Dev, Test, UAT, and Prod environments.
  • Provision workspaces, compute, clusters, and platform-level settings.
  • Develop CI/CD pipelines for Databricks configurations, notebooks, jobs, and deployments.
  • Configure Unity Catalog, RBAC, secrets management, and least-privilege access.
  • Monitor platform health, troubleshoot production issues, and optimize workloads for cost.

Kenntnisse

Databricks Lakehouse
Databricks Notebooks
PySpark DataFrame API
SQL transformations
Databricks Jobs
Unity Catalog
Databricks Autoloader
Structured Streaming
AWS Stack
Batch and incremental pipelines

Tools

Terraform
Infrastructure as Code (IaC)

Jobbeschreibung

Vallum Associates is seeking a Senior Databricks Platform Engineer to design, build, and operate enterprise Databricks Lakehouse platforms for banking and financial services clients. You will provision workspaces, implement CI/CD, and enforce security controls across multiple environments and regions.

Responsibilities include configuring Unity Catalog, RBAC, and secrets management; automating IaC with Terraform; and integrating Databricks with AWS services.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior Enterprise Databricks Lakehouse Architect
Senior Enterprise Databricks Lakehouse Architect

DCV Technologies • City Of London

Vor Ort
GBP 90.000 - 130.000
Data Architect
Data Architect

Vallum Associates • Greater London

Vor Ort
GBP 90.000 - 130.000
Databricks Architect
Databricks Architect

DCV Technologies • City Of London

Vor Ort
GBP 90.000 - 130.000
Senior Databricks Lakehouse Architect: Scale Platforms
Senior Databricks Lakehouse Architect: Scale Platforms

Unison Group • Norwich

Vor Ort
GBP 120.000 - 160.000
Databricks Engineer
Databricks Engineer

Gazelle Global • City Of London

Hybrid
GBP 85.000 - 120.000
Databricks Architect
Databricks Architect

Project Recruit • Greater London

Hybrid
GBP 111.000 - 166.000
Databricks Lakehouse Architect - Hybrid UK
Databricks Lakehouse Architect - Hybrid UK

Project Recruit • Greater London

Hybrid
GBP 111.000 - 166.000
Databricks Lakehouse Engineer - Hybrid (London/Manchester)
Databricks Lakehouse Engineer - Hybrid (London/Manchester)

Gazelle Global • City Of London

Hybrid
GBP 85.000 - 120.000
Senior Databricks Solution Architect
Senior Databricks Solution Architect

Unison Group • Norwich

Vor Ort
GBP 120.000 - 160.000
Senior Databricks Engineer — Lakehouse Architect (London)
Senior Databricks Engineer — Lakehouse Architect (London)

DVF Recruitment • Greater London

Vor Ort
GBP 138.000 - 148.000