Senior Data Engineer

Octopus Energy; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Hybrid work from London

Employee Benefits hub access

Flexible interview process

Job summary

Octopus Energy seeks a Senior Data Engineer for the Flexibility team in London, with a focus on building greenfield data systems in a new AWS environment and driving data platform improvements.

You will lead data capability, upskill engineers, and ensure robust data processing and warehousing for global scalability, interfacing with a Databricks warehouse and core data stack.

Qualifications

• Strong SQL and Python experience with data engineering focus.
• Experience building scalable databases and APIs (Django/FastAPI) is a plus.
• Proficiency with AWS data services and Databricks for processing.
• Kubernetes, Docker, and monitoring tools for DataOps advantageous.
• Familiarity with dbt, Airflow, and data warehousing concepts.
• Ability to translate needs into scalable, documented data solutions.

Responsibilities

• Act as the team’s first full‑time data engineer; define data capability and direction.
• Upskill backend engineers and contribute as a data expert across projects.
• Establish greenfield data systems in a new AWS environment.
• Provide high-quality data processing and warehousing foundations.
• Maintain and improve data applications for long-term global scalability.
• Interface with the Databricks-based data warehouse and drive platform improvements.

Skills

SQL

Python

AWS

Databricks

Kubernetes

Docker

Airflow

dbt

PostgreSQL

Data modeling

Tools

Databricks

Django

FastAPI

Grafana

Datadog

Prometheus

Job description

We're making energy fair, clean, and simple for all using technology.

Octopus Energy started with a bold idea: to build Britain’s first truly digital energy supplier. By combining world-class tech with brilliant humans who care deeply about customers and driving the renewable energy transition, we made it happen and in 2025, we became Britain’s largest energy supplier.

Octopus Energy Group is a global energy transition collective. 10 businesses working across 4 continents to tackle energy transformation at nearly every front.

And we constantly push to make energy better. Tirelessly campaigning for fair protections for customers. And building innovative technologies that forge a path to a green energy system.

We’re made up of 10,000+ authentic, committed people working around the world on stuff you'd never expect. We're united by a shared goal: to drive the global green energy revolution. Read our Spotlight series to meet some of the team.

To deliver on this mission, we are looking for a Senior Data Engineer to join the Flexibility team.

The Flexibility team was established in early 2026, and has been growing throughout the year. The team is focused on greenfield opportunities at the cutting edge of Octopus' flexibility strategy, and aims to enable rapid response to global flex opportunities.

They are building the next generation of products and tools to make energy more flexible. These include our flagship Intelligent Octopus product automating demand shift for 300,000 customers with electric cars, home batteries or smart heating devices, saving 2 million customers money through Saving Sessions and Free Electricity Sessions, and managing 568MW of large grid-scale batteries to balance the system. The team develops products that are used by millions of customers, helping boost renewables use and decarbonise energy systems worldwide.

We embrace flat hierarchies and an open, agile culture that fosters innovation, flexibility, and creativity.

We don’t hang our personalities up with our coats and nor should you. At Octopus, we hire great people who get stuff done, all whilst being themselves.

If this sounds exciting, we’d love to chat.

What you'll do

• Acting as the flexibility team’s first full-time data engineer, establish the team’s data capability, lead the team’s data engineering technical direction and represent the team to the cross-team data community

• Upskill data-literate backend engineers, act as the team's data expert and as a multiplier on other engineers' impact

• Establish greenfield data engineering systems in a newly established AWS environment

• Provide a foundational layer of high quality data processing and warehousing that will enable future projects for both our team and others

• Maintain and develop critical data applications - scoping and implementing architectural improvements for long-term global scalability, robustness and operational efficiency

• Interface with the established data warehouse, built on Databricks

• Take ownership of data platform improvements that enhance the capabilities for all teams and drive trust in the stability of the system

What you'll have

• Strong aptitude with SQL, Python and AWS data stack essential;

• Experience building efficient, scalable databases and APIs (e.g. Django, FastAPI) a huge plus;

• Experience in Kubernetes, Docker, Spark and related monitoring tools (e.g. DataDog, Grafana, Prometheus) for DataOps a huge plus;

• Experience with Airflow a huge plus;

• Experience with dbt for pipeline modelling also beneficial;

• Skilled at shaping needs into a solid set of requirements and designing scalable solutions to meet them;

• Able to quickly understand new domain areas and visualise data effectively;

• Team player excited at the idea of ownership across lots of different projects and tools;

• Drives knowledge sharing and documentation for a more effective platform;

• Desirable: energy domain knowledge

Our core data stack

• Python as our main programming language

• Databricks Spark for data processing

• Databricks/dbt/SQL for data modelling and analytics

• Streamlit for data applications and visualisations

• Airflow for job scheduling and tracking

• CircleCI for continuous deployment

• Parquet and Delta file formats on S3 for data lake storage

• Terraform for our infrastructure definition

• Kubernetes for data services and task orchestration

• Datadog/Grafana/Prometheus for platform monitoring

• Django for custom databases and frameworks

• Postgres / Aurora for our relational databases

• Notion for documentation

We have a preference for candidates who can work hybrid from our London office, but we're open to fully remote candidates (you do need to be based in the UK).

Why else you'll love it here

Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!

Octopus Energy Group is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We were named the UK's top company to work for in 2025, and we ranked in the top ten in the Sunday Times Best Places to Work 2026. Our Group CEO, Greg has recorded a podcast about our culture and how we empower our people. We’ve also been placed in the top 10 companies for senior leadership

Visit our UK perks hub - Octopus Employee Benefits

P.S. Our process usually takes up to 4 weeks, but we’ll always do our best to flex around what works for you. Along the way, you’ll chat with our recruitment team and your Recruiter will help you throughout different stages. Got any burning questions before then? Drop us a message at [e-mail] and we’d love to help!

Are you ready for a career with us? We want to ensure you have all the tools and environment you need to unleash your potential.Need any specific accommodations?Whether you require specific accommodations or have a unique preference, let us know, and we'll do what we can to customise your interview process for comfort and maximum magic!

Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.