Senior Data Engineer (Databricks) in Surrey

Energy Jobline ZR; Surrey; Hybrid; CAD 101,000 - 168,000; Full time

Benefits offered by this job

Hybrid working model

Databricks investment in technology

Large-scale Lakehouse platform project

Professional development & training

Job summary

Energy Jobline ZR in Surrey is seeking a Senior Data Engineer with strong Databricks experience to join a hybrid team building a modern Lakehouse platform on Azure. You will design and implement scalable data pipelines, influence architecture and drive best practices across the data stack.

The role is hands-on, with opportunities to work on large-scale data, and to grow through training, certifications and technical exposure within a collaborative, engineering-driven environment.

Qualifications

• Commercial experience building solutions within Databricks.
• Strong hands-on PySpark, Spark SQL, and Delta Lake.
• Experience designing and supporting production-grade ETL/ELT pipelines.
• Strong Python and SQL development skills.
• Experience with large-scale distributed data processing environments.
• Understanding of Lakehouse architecture and modern data engineering best practices.
• Cloud experience within Azure, AWS or GCP.
• Excellent stakeholder management and communication skills.

Responsibilities

• Design, build and optimise Databricks-based solutions.
• Build scalable data pipelines using Databricks and PySpark.
• Develop high-performance batch and streaming data solutions.
• Design Delta Lake lakehouse architectures with medallion principles.
• Optimize Databricks workloads for performance and cost.
• Implement data quality, monitoring and observability frameworks.
• Support governance, security and access management.
• Collaborate with Data Scientists, Analysts and Product teams to deliver data products.
• Drive engineering excellence through code reviews and best practices.
• Identify opportunities to improve platform performance and reduce cloud costs.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

ETL/ELT pipelines

Python

SQL

Lakehouse architecture

Cloud platforms

Stakeholder management

Communication

Tools

Databricks

Delta Lake

Spark

Job description

Job Description

Senior Data Engineer (Databricks) - Surrey (Hybrid) - Up to £90,000

We're working with an innovative, data-driven organisation that is investing heavily in its Databricks platform and looking to add a Senior Data Engineer to its growing Data Engineering team.

This role is ideal for someone who enjoys being hands‑on with Databricks and wants to play a key role in building and evolving a modern Lakehouse platform. You'll be working with large-scale datasets, designing robust data pipelines, and helping shape best practices across a cloud‑first Azure environment.

You’ll join a collaborative team where Data Engineering is viewed as a core business function, with the opportunity to influence architecture, tooling decisions and the future direction of the platform.

The Opportunity

As a Senior Data Engineer, you'll spend most of your time designing, building and optimising solutions within Databricks.

Key responsibilities include:

• Building and maintaining scalable data pipelines using Databricks and PySpark.
• Developing high-performance batch and streaming data solutions.
• Designing and implementing modern Lakehouse architectures using Delta Lake and medallion design principles.
• Optimising Databricks workloads for performance, reliability and scalability.
• Implementing data quality, monitoring, and observability frameworks.
• Supporting governance, security, and access management within the data platform.
• Collaborating with Data Scientists, Analysts and Product teams to deliver business‑critical data products.
• Driving engineering excellence through code reviews, knowledge sharing and technical best practices.
• Identifying opportunities to improve platform performance and reduce cloud costs.
• Contributing to the ongoing enhancement of the Databricks ecosystem and data engineering standards.

What You'll Need

We're particularly interested in engineers with strong hands‑on Databricks experience.

Essential Skills

• Commercial experience building solutions within Databricks.
• Strong hands‑on expertise with PySpark, Spark SQL, and Delta Lake.
• Experience designing and supporting production‑grade ETL/ELT pipelines.
• Strong Python and SQL development skills.
• Experience working with large‑scale distributed data processing environments.
• Understanding of Lakehouse architecture and modern data engineering best practices.
• Cloud experience within Azure, AWS or GCP.
• Excellent stakeholder management and communication skills.

What's On Offer?

• Salary up to £90,000.
• Hybrid working model.
• Significant investment in Databricks and modern data technologies.
• Opportunity to work on a large‑scale Lakehouse platform.
• Exposure to complex data engineering challenges.
• Strong engineering culture with a focus on technical excellence.
• Ongoing training, certification support, and career development.
• Clear progression opportunities within a growing organisation.