Databricks Engineer

Gazelle Global Consulting Limited

Greater London

Hybrid

GBP 70,000 - 95,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Gazelle Global Consulting Limited is seeking an experienced Databricks Engineer to join a banking and financial services programme in London/Manchester. You will build and manage enterprise‑scale Lakehouse platforms, implementing secure, scalable Databricks environments and supporting data engineering teams across environments and clouds.

The role covers platform configuration, automation, CI/CD, and performance optimisation, with a hands‑on approach to Databricks jobs, pipelines, and security

Qualifications

  • Hands-on Databricks and PySpark experience required.
  • Strong knowledge of Delta Lake and Lakehouse architecture.
  • Experience with Unity Catalog, Autoloader and Structured Streaming.
  • Familiarity with AWS services (S3, IAM, KMS, Glue, Lambda).
  • Proficient in Git, CI/CD, and data pipeline development.

Responsibilities

  • Build and maintain Databricks Lakehouse platforms across environments.
  • Develop data pipelines using PySpark, SQL and Delta Lake.
  • Configure Unity Catalog, permissions, access controls, security policies.
  • Implement CI/CD pipelines and automate platform deployments.
  • Manage Databricks Jobs, Workflows and Declarative Pipelines.
  • Integrate Databricks with AWS services and cloud infrastructure.
  • Support batch and incremental data processing and optimise performance.

Skills

Databricks
PySpark
Delta Lake
Unity Catalog
CI/CD

Tools

Git
CI/CD pipelines
Python

Job description

We're looking for an experienced Databricks Engineer to join an exciting banking and financial services programme, building and managing enterprise-scale Lakehouse platforms.

You'll play a key role in developing secure, scalable and reliable Databricks environments, supporting data engineering teams across multiple environments and cloud platforms. This is a hands-on opportunity involving platform configuration, automation, deployment and performance optimisation.

Key Responsibilities:

  • Build and maintain Databricks Lakehouse platforms across development, testing and production environments.
  • Develop data pipelines using PySpark, SQL and Delta Lake.
  • Configure Unity Catalog, permissions, access controls and security policies.
  • Implement CI/CD pipelines and automate platform deployments.
  • Manage Databricks Jobs, Workflows and Declarative Pipelines.
  • Integrate Databricks with AWS services and cloud infrastructure.
  • Support batch and incremental data processing.
  • Optimise platform performance, monitoring and operational reliability.

Key Skills:

  • Strong hands-on experience with Databricks and PySpark.
  • Excellent knowledge of Delta Lake and Lakehouse architecture.
  • Experience with Unity Catalog, Autoloader and Structured Streaming.
  • Knowledge of AWS S3, IAM, KMS, Glue and Lambda.
  • Experience with Git, CI/CD and data pipeline development.

Location: London / Manchester - Hybrid, 3 days onsite.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Engineer
Databricks Engineer

Gazelle Global • City Of London

Hybrid
GBP 85,000 - 120,000
Databricks Lakehouse Engineer - Hybrid (London/Manchester)
Databricks Lakehouse Engineer - Hybrid (London/Manchester)

Gazelle Global • City Of London

Hybrid
GBP 85,000 - 120,000
Databricks Architect
Databricks Architect

Gazelle Global Consulting Limited • Manchester

Hybrid
GBP 111,000 - 166,000
Databricks Lakehouse Engineer - Hybrid (London/Manchester)
Databricks Lakehouse Engineer - Hybrid (London/Manchester)

Gazelle Global Consulting Limited • Greater London

Hybrid
GBP 70,000 - 95,000
Databricks Architect
Databricks Architect

Project Recruit • Greater London

Hybrid
GBP 111,000 - 166,000
Databricks Platform Engineer
Databricks Platform Engineer

Sagacity Solutions Ltd. • Greater London

Hybrid
GBP 85,000 - 120,000
Databricks Lakehouse Architect — Hybrid, 4-Month Contract
Databricks Lakehouse Architect — Hybrid, 4-Month Contract

Gazelle Global Consulting Limited • Manchester

Hybrid
GBP 111,000 - 166,000
Databricks Architect
Databricks Architect

DCV Technologies • Greater London

On-site
GBP 90,000 - 140,000
Databricks Lakehouse Architect - Hybrid UK
Databricks Lakehouse Architect - Hybrid UK

Project Recruit • Greater London

Hybrid
GBP 111,000 - 166,000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

ISx4 Group • Belfast City District

Hybrid
GBP 70,000 - 100,000