Senior Data Engineer — Databricks Platform Lead (Remote UK)

Energy Jobline CVL; Royal Borough of Greenwich; Remote; GBP 77,000 - 94,000; Full time

Benefits offered by this job

Health insurance

Income protection

Life assurance

Subsidised gym membership

25 days' holiday plus birthday off

Job summary

Energy Jobline CVL is seeking a Senior Data Engineer to own and evolve our data platform. You will build scalable pipelines in Databricks, shape architecture, and enable self-service data access across the business from our UK HQ with remote work options.

The role requires strong PySpark, Spark SQL, Delta Lake skills, and a track record in enterprise data pipelines, cloud experience (AWS preferred) and CI/CD practices. Attractive bonus and benefits are included.

Qualifications

• Senior level experience in data engineering with hands-on Databricks experience.
• Advanced SQL and Python coding skills.
• Proven track record of building enterprise-scale data pipelines and ETL/ELT.
• Strong data architecture, modelling and platform design.
• Cloud experience (AWS preferred; Azure acceptable) and CI/CD familiarity.

Responsibilities

• Design, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake.
• Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems.
• Shape enterprise data architecture, balancing scalability, performance, security and maintainability.
• Partner with stakeholders across Finance, Product, Sales, Marketing and Engineering to turn business challenges into technical solutions.
• Embed data quality, governance and access controls throughout the data lifecycle.
• Mentor a junior engineer and help mature a growing data function.

Skills

SQL

Python

Data architecture

Data modelling

Cloud experience

CI/CD

Source control

AWS

Azure

Tools

Databricks

PySpark

Spark SQL

Delta Lake

Job description

Energy Jobline CVL is seeking a Senior Data Engineer to own and evolve our data platform. You will build scalable pipelines in Databricks, shape architecture, and enable self-service data access across the business from our UK HQ with remote work options.

The role requires strong PySpark, Spark SQL, Delta Lake skills, and a track record in enterprise data pipelines, cloud experience (AWS preferred) and CI/CD practices. Attractive bonus and benefits are included.