Databricks Architect

Gazelle Global Consulting Limited

Manchester

Hybrid

GBP 111,000 - 166,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Gazelle Global Consulting Limited seeks an experienced Databricks Architect to lead a major data transformation in the banking sector. You will own enterprise Databricks Lakehouse platforms, optimizing data environments across regions and driving security, automation and performance.

You will design pipelines, implement Autoloader and Streaming workloads, and mentor teams on Delta Lake, Unity Catalog and CI/CD within a hybrid London/Manchester setup.

Qualifications

  • Strong hands-on experience with Databricks notebooks, jobs and workflows.
  • Advanced PySpark and SQL for large-scale data processing.
  • Experience with Delta Lake and Unity Catalog.
  • Knowledge of Databricks Autoloader and Structured Streaming.
  • Experience building batch and incremental data pipelines.
  • Strong understanding of Lakehouse and Medallion architectures.
  • AWS experience covering S3, IAM, KMS, Glue and Lambda.
  • Experience migrating AWS-native workloads to Databricks.
  • Knowledge of Terraform, Infrastructure as Code and CI/CD.
  • Strong understanding of distributed data processing and performance tuning.

Skills

Databricks
PySpark
SQL
Delta Lake
Unity Catalog
Autoloader
Structured Streaming
Lakehouse architecture
Medallion architecture
AWS (S3/IAM/KMS/Glue/Lambda)
Terraform
CI/CD
IaC
Performance tuning

Tools

Databricks
AWS
Terraform
CI/CD

Job description

Databricks Architect | 4-Month Contract | London / Manchester | Hybrid (3 Days Onsite)

I'm currently recruiting for an experienced Databricks Architect to support a major data transformation programme within the banking and financial services sector.

This is an excellent opportunity to take ownership of enterprise Databricks Lakehouse platforms, helping build and optimise scalable data environments across multiple regions. You'll play a key role in platform architecture, data engineering, security, automation and performance optimisation.

Key Skills & Experience:

  • Strong hands-on experience with Databricks, including Notebooks, Jobs and Workflows.
  • Advanced PySpark and SQL skills for large-scale data processing.
  • Experience with Delta Lake and Unity Catalog.
  • Knowledge of Databricks Autoloader and Structured Streaming.
  • Experience building batch and incremental data pipelines.
  • Strong understanding of Lakehouse and Medallion architecture.
  • AWS experience covering S3, IAM, KMS, Glue and Lambda.
  • Experience migrating AWS-native workloads to Databricks.
  • Knowledge of Terraform, Infrastructure as Code and CI/CD.
  • Strong understanding of distributed data processing and performance tuning.

Contract: 4 months
Location: London or Manchester
Working Pattern: Hybrid, 3 days onsite (Tuesday-Thursday).

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Architect
Databricks Architect

Project Recruit • Greater London

Hybrid
GBP 111,000 - 166,000
Databricks Lakehouse Architect — Hybrid, 4-Month Contract
Databricks Lakehouse Architect — Hybrid, 4-Month Contract

Gazelle Global Consulting Limited • Manchester

Hybrid
GBP 111,000 - 166,000
Databricks Engineer
Databricks Engineer

Gazelle Global Consulting Limited • Greater London

Hybrid
GBP 70,000 - 95,000
Data Architect - Databricks & AWS
Data Architect - Databricks & AWS

Corecom Consulting • Leeds

Hybrid
GBP 65,000 - 90,000
Databricks Lakehouse Architect - Hybrid UK
Databricks Lakehouse Architect - Hybrid UK

Project Recruit • Greater London

Hybrid
GBP 111,000 - 166,000
Databricks Engineer
Databricks Engineer

Gazelle Global • City Of London

Hybrid
GBP 85,000 - 120,000
Databricks Solution Architect
Databricks Solution Architect

Undisclosed Company • Greater London

Hybrid
GBP 112,000 - 147,000
Data Architect
Data Architect

Brio Digital • City Of London

Remote
GBP 112,000 - 147,000
Data Architect
Data Architect

Brio Digital • Greater London

Remote
GBP 112,000 - 147,000
Data Architect
Data Architect

Brio Digital • United Kingdom

Remote
GBP 112,000 - 147,000