Data engineer in renewable energy

Octopus Energy Group; Greater London; On-site; GBP 70,000 - 105,000; Full time

Job summary

Octopus Energy Generation (OEGEN) seeks a Data Engineer to design, build, and maintain scalable data pipelines using Databricks, Python, and SQL. You will help translate complex energy data into reliable insights for Finance, Asset Management, and Fund Management.

Join a fast-growing, mission-driven team in London, collaborating with non-technical stakeholders and shaping governance, data quality, and automated workflows across an expanding renewable energy portfolio.

Qualifications

• Strong SQL and Python used daily for pipeline development and automation.
• Experience with cloud data platforms (Databricks preferred) and version control (Git/GitHub).
• Solid understanding of data modelling, warehousing patterns, and ETL/ELT design.
• Comfortable working with PostgreSQL or similar relational databases.

Responsibilities

• Design, build, and maintain scalable data pipelines in Databricks.
• Own and evolve Databricks models, schemas, testing, and data warehouse hygiene.
• Automate manual data processes using Python; reduce ad-hoc workflows.
• Build dashboards and reports in Streamlit/ HTMX (FastAPI) used by Finance and Asset teams.
• Integrate internal and third-party systems via REST APIs; improve data accessibility.

Skills

SQL

Python

Databricks

Git/GitHub

Data modelling

ETL/ELT design

Tools

Streamlit

HTMX

FastAPI

PostgreSQL

REST APIs

Job description

Описание:

Help us make a big green dent in the universe. We're on a mission to drive the global renewable energy revolution, and we need many more people to help us make our vision a reality. Octopus Energy Generation (OEGEN) is a leader in sourcing, investing in, and managing a wide range of utility-scale renewable energy assets. As we continue to expand our investment base, we are dedicated to building a diverse team that reflects the communities we serve. Currently, we manage a global portfolio of over £8 billion in renewable energy assets.

Задачи:

• Design, build, and maintain scalable data pipelines in Databricks, ensuring data is reliable, timely, and well-documented.
• Own and evolve our Databricks models - define schemas, enforce testing, and keep the warehouse clean.
• Automate manual data processes using Python, replacing spreadsheets and ad-hoc workflows with robust, repeatable jobs.
• Build performance dashboards and reports in Streamlit and HTMX (FastAPI) that Finance, Asset Management, and Fund Management actually use.
• Integrate internal and third-party systems via REST APIs, improving data accessibility across the business.
• Champion data quality - implement validation, monitoring, and governance practices that give stakeholders confidence in the numbers.
• Collaborate directly with non-technical teams to understand their problems and translate them into data solutions.

Требования:

• Strong SQL and Python skills, used daily for pipeline development, data modelling, and automation.
• Experience with modern data stack tooling: a cloud data platform (Databricks preferred), and version control (Git/GitHub).
• A solid understanding of data modelling, warehousing patterns, and ETL/ELT design.
• To be comfortable working with Postgres or similar relational databases.
• Clear communication - you can explain a data model to a fund manager and discuss trade-offs with an engineer.
• Будет плюсом: Full-stack development experience - particularly with Streamlit, FastAPI, or HTMX;
• Будет плюсом: Experience building and managing REST APIs, including authentication, rate limiting, and documentation;
• Будет плюсом: Familiarity with renewable energy, infrastructure investment, or financial services data;
• Будет плюсом: Experience evaluating and adopting AI/ML tooling to augment engineering workflows

Условия:

The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit! An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We were recently named the UK's top company to work for, and we ranked in the top ten in the Sunday Times Best Places to Work 2024.