Databricks Engineer

Gazelle Global

City Of London

Hybrid

GBP 85,000 - 120,000

Full time

20 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Gazelle Global is seeking an experienced Databricks Engineer to join a banking and financial services programme in London/Manchester. You will build and manage enterprise-scale Lakehouse platforms, optimize performance and drive secure data pipelines across development, testing and production environments.

Responsibilities include configuring Unity Catalog, implementing CI/CD, and integrating Databricks with AWS services. The role is hybrid with 3 days onsite.

Qualifications

  • Extensive hands-on Databricks engineering experience.
  • Strong PySpark, Delta Lake and SQL skills.
  • Experience configuring Unity Catalog and access controls.
  • Proven ability to design and implement CI/CD for data platforms.

Responsibilities

  • Build and maintain Databricks Lakehouse platforms across dev, test, and prod.
  • Develop data pipelines with PySpark, SQL and Delta Lake.
  • Configure Unity Catalog, permissions, and security policies.
  • Implement CI/CD and automate platform deployments.
  • Manage Databricks Jobs, Workflows, and Declarative Pipelines.
  • Integrate Databricks with AWS services and cloud infra.
  • Support batch and incremental data processing.
  • Optimise performance, monitoring and reliability.

Skills

Databricks
PySpark
Delta Lake
Structured Streaming
CI/CD
Data pipelines

Tools

Unity Catalog
Autoloader
Git
AWS S3
IAM
KMS
Glue
Lambda

Job description

We're looking for an experienced Databricks Engineer to join an exciting banking and financial services programme, building and managing enterprise-scale Lakehouse platforms.

You'll play a key role in developing secure, scalable and reliable Databricks environments, supporting data engineering teams across multiple environments and cloud platforms. This is a hands-on opportunity involving platform configuration, automation, deployment and performance optimisation.

Key Responsibilities:
  • Build and maintain Databricks Lakehouse platforms across development, testing and production environments.
  • Develop data pipelines using PySpark, SQL and Delta Lake.
  • Configure Unity Catalog, permissions, access controls and security policies.
  • Implement CI/CD pipelines and automate platform deployments.
  • Manage Databricks Jobs, Workflows and Declarative Pipelines.
  • Integrate Databricks with AWS services and cloud infrastructure.
  • Support batch and incremental data processing.
  • Optimise platform performance, monitoring and operational reliability.
Key Skills:
  • Strong hands-on experience with Databricks and PySpark.
  • Excellent knowledge of Delta Lake and Lakehouse architecture.
  • Experience with Unity Catalog, Autoloader and Structured Streaming.
  • Knowledge of AWS S3, IAM, KMS, Glue and Lambda.
  • Experience with Git, CI/CD and data pipeline development.

Location: London / Manchester - Hybrid, 3 days onsite.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Lakehouse Engineer - Hybrid (London/Manchester)
Databricks Lakehouse Engineer - Hybrid (London/Manchester)

Gazelle Global • City Of London

Hybrid
GBP 85,000 - 120,000
Databricks Architect
Databricks Architect

Project Recruit • Greater London

Hybrid
GBP 111,000 - 166,000
Databricks Platform Engineer
Databricks Platform Engineer

Sagacity Solutions Ltd. • Greater London

Hybrid
GBP 85,000 - 120,000
Databricks Engineer
Databricks Engineer

X4 Technology • Greater London, Birmingham

Hybrid
GBP 65,000 - 95,000
Databricks Lakehouse Architect - Hybrid UK
Databricks Lakehouse Architect - Hybrid UK

Project Recruit • Greater London

Hybrid
GBP 111,000 - 166,000
Data Architect
Data Architect

Vallum Associates • Greater London

On-site
GBP 90,000 - 130,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Tenth Revolution Group • United Kingdom

Remote
GBP 90,000 - 130,000
Databricks Engineer
Databricks Engineer

twentyAI • Greater London

Hybrid
GBP 70,000 - 110,000
Databricks Solution Architect
Databricks Solution Architect

Undisclosed Company • Greater London

Hybrid
GBP 112,000 - 147,000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

ISx4 Group • Belfast City District

Hybrid
GBP 70,000 - 100,000