Senior Data Engineer in London

Energy Jobline CVL; Royal Borough of Greenwich; Remote; GBP 77,000 - 94,000; Full time

Benefits offered by this job

Health insurance

Income protection

Life assurance

Subsidised gym membership

25 days' holiday plus birthday off

Job summary

Energy Jobline CVL is seeking a Senior Data Engineer to own and evolve our data platform. You will build scalable pipelines in Databricks, shape architecture, and enable self-service data access across the business from our UK HQ with remote work options.

The role requires strong PySpark, Spark SQL, Delta Lake skills, and a track record in enterprise data pipelines, cloud experience (AWS preferred) and CI/CD practices. Attractive bonus and benefits are included.

Qualifications

• Senior level experience in data engineering with hands-on Databricks experience.
• Advanced SQL and Python coding skills.
• Proven track record of building enterprise-scale data pipelines and ETL/ELT.
• Strong data architecture, modelling and platform design.
• Cloud experience (AWS preferred; Azure acceptable) and CI/CD familiarity.

Responsibilities

• Design, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake.
• Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems.
• Shape enterprise data architecture, balancing scalability, performance, security and maintainability.
• Partner with stakeholders across Finance, Product, Sales, Marketing and Engineering to turn business challenges into technical solutions.
• Embed data quality, governance and access controls throughout the data lifecycle.
• Mentor a junior engineer and help mature a growing data function.

Skills

SQL

Python

Data architecture

Data modelling

Cloud experience

CI/CD

Source control

AWS

Azure

Tools

Databricks

PySpark

Spark SQL

Delta Lake

Job description

UK HQ based & fast‑growing software business (400+ staff, globally), serving hundreds of enterprise customers worldwide, are looking for a Senior Data Engineer to help shape the future of its data platform. You'll take ownership of building scalable data solutions in Databricks primarily, establishing a single source of truth, and enabling trusted, self‑service access to data across the business.

Location: UK, remote with very occasional visits to the office in London. Salary: Up to £85,000 basic, plus 10% bonus and an extensive benefits package.

What you'll be doing

Design, build and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL and Delta Lake.
Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems.
Shape enterprise data architecture, balancing scalability, performance, security and maintainability.
Partner with stakeholders across Finance, Product, Sales, Marketing and Engineering to turn business challenges into technical solutions.
Embed data quality, governance and access controls throughout the data lifecycle.
Mentor a junior engineer and help mature a growing data function.

What you need to bring

“Senior” level experience in data engineering, with strong hands‑onDatabricks skills (PySpark, Spark SQL, Delta Lake, etc)
Advanced SQL and Python coding skills.
A track record of building and optimising enterprise‑scale data pipelines and ETL/ELT solutions.
Solid grounding in data architecture, modelling and modern data platform design.
Cloud experience, preferably AWS (but Azure is totally fine), and familiarity with CI/CD and source control best practice.
Desirable: More Data Science leaning background or want to explore in this role:ML / AI & data / predictive modelling strategies.

Why you'll love this job

A highly visible, hands‑on role with real influence over data architecture and platform strategy.
Join a small, high‑impact team at the heart of the company's data strategy, with genuine scope to shape how it evolves. We are near the beginning of our Data Ops’ journey – so an excellent opportunity to shape the future!
Extensive benefits package including health insurance, income protection, life assurance, subsidised gym membership and 25 days' holiday plus your birthday off.