Data Engineer

Octopus Energy; Greater London; On-site; GBP 65,000 - 100,000; Full time

Job summary

Octopus Energy is seeking a Data Engineer to own data pipelines from source systems to decision-ready outputs. You’ll build and maintain pipelines in Databricks, model data, and develop dashboards for investment and asset management teams.

You’ll also prototype internal tools using Streamlit, FastAPI, or HTMX to put data in the hands of stakeholders. In the first 90 days you’ll own at least one critical pipeline and contribute to a reporting layer used by Fund/Asset Management, while

Qualifications

• Strong SQL and Python skills used daily for pipeline development and automation.
• Experience with modern data stack tooling: cloud data platform (Databricks) and version control (Git/GitHub).
• Understanding of data modelling, warehousing patterns, and ETL/ELT design.

Responsibilities

• Design, build, and maintain scalable data pipelines in Databricks with reliable data delivery.
• Own and evolve Databricks models; define schemas and enforce testing.
• Automate manual data processes using Python; replace spreadsheets with robust jobs.
• Build dashboards and reports in Streamlit and HTMX (FastAPI) used by Finance and Asset Management.
• Integrate internal and third-party systems via REST APIs to improve data access.
• Champion data quality with validation, monitoring, and governance practices.
• Collaborate with non-technical teams to translate problems into data solutions.

Skills

SQL

Python

Databricks

Data modelling

ETL/ELT design

PostgreSQL

REST APIs

Git/GitHub

Communication

Tools

Databricks

Git/GitHub

Streamlit

FastAPI

HTMX

REST APIs

Job description

Help us make a big green dent in the universe. We're on a mission to drive the global renewable energy revolution, and we need many more people to help us make our vision a reality.

Octopus Energy Generation (OEGEN) is a leader in sourcing, investing in, and managing a wide range of utility-scale renewable energy assets. As we continue to expand our investment base, we are dedicated to building a diverse team that reflects the communities we serve. Currently, we manage a global portfolio of over £8 billion in renewable energy assets.

We are committed to delivering best-in-class responsible investment activity, offering like-minded investors the means and products to invest their capital sustainably. It is our ambition to change the entire energy lifecycle and make every green electron matter, delivering the best outcomes for customers, investors, the environment and society, accelerating the transition to net zero.

OEGEN Data, Tech & Transformation Team

We are embarking on a comprehensive transformation program designed to drive significant advancements in our business operations and technology landscape. Our primary goal is to transition from our current reliance on legacy systems and specialized off-the-shelf tools to a more integrated, AI-driven, and data-centric operational model.

Leveraging insights and guidance from our other technically mature entities like Kraken and OE, we plan to adopt cutting-edge tools and capabilities, particularly in AI and Python-driven solutions.

By investing in a diverse range of skills, we aim to create a hybrid team capable of operating in both our legacy and future environments, ultimately transforming OEGEN into an efficient, data-driven organization.

About the role

We’re looking for a Data Engineer who can own the journey of data from source systems to decision-ready outputs. You’ll build and maintain pipelines, model data, stand up dashboards, and integrate systems via APIs. In a team this size, you’ll also get involved in application development - building internal tools with Streamlit, FastAPI, or HTMX that put data directly in the hands of our investment and asset management teams.

In your first 3 months you’ll have taken ownership of at least one critical pipeline from an external system into Databricks, and built or materially improved a reporting layer used by Fund Management or Asset Management.

What you'll do

• Design, build, and maintain scalable data pipelines in Databricks, ensuring data is reliable, timely, and well-documented.
• Own and evolve our Databricks models - define schemas, enforce testing, and keep the warehouse clean.
• Automate manual data processes using Python, replacing spreadsheets and ad-hoc workflows with robust, repeatable jobs.
• Build performance dashboards and reports in Streamlit and HTMX (FastAPI) that Finance, Asset Management, and Fund Management actually use.
• Integrate internal and third-party systems via REST APIs, improving data accessibility across the business.
• Champion data quality - implement validation, monitoring, and governance practices that give stakeholders confidence in the numbers.
• Collaborate directly with non-technical teams to understand their problems and translate them into data solutions.

What you'll need

• Strong SQL and Python skills, used daily for pipeline development, data modelling, and automation.
• Experience with modern data stack tooling: a cloud data platform (Databricks preferred), and version control (Git/GitHub).
• A solid understanding of data modelling, warehousing patterns, and ETL/ELT design.
• To be comfortable working with Postgres or similar relational databases.
• Clear communication - you can explain a data model to a fund manager and discuss trade-offs with an engineer.
• A bias toward shipping: you’d rather get something working and iterate than spend weeks in design.

Bonus points for

• Full-stack development experience - particularly with Streamlit, FastAPI, or HTMX.
• Experience building and managing REST APIs, including authentication, rate limiting, and documentation.
• Familiarity with renewable energy, infrastructure investment, or financial services data.
• Experience evaluating and adopting AI/ML tooling to augment engineering workflows.

Why else you'll love it here

• Wondering what the salary for this role is?Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!
• Octopus Energy Group is aunique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We were recently named the UK's top company to work for, and we ranked in the top ten in the Sunday Times Best Places to Work 2024. Our Group CEO, Greg has recorded a podcast about our culture and how we empower our people. We’ve also been placed in the top 10 companies for senior leadership

Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.