Data Engineer: Scalable Pipelines for Green Energy

Octopus Energy Group; Greater London; On-site; EUR 70,000 - 100,000; Full time

Job summary

Octopus Energy Group is seeking a Data Engineer to own data from source systems to decision-ready outputs. You will build and maintain pipelines in Databricks, model data, and contribute to dashboards and internal tools.

You’ll collaborate with investment and asset management teams, automate processes with Python, and integrate systems via REST APIs to improve data access and quality across the business.

Qualifications

• Proven experience building data pipelines with SQL and Python.
• Strong knowledge of data warehousing and ETL/ELT patterns.
• Experience with Databricks and modern data stack tools.
• Ability to translate business needs into data solutions.

Responsibilities

• Design, build, and maintain scalable data pipelines in Databricks, ensuring data is reliable, timely, and well-documented.
• Own and evolve Databricks models – define schemas, enforce testing, and keep the warehouse clean.
• Automate manual data processes using Python, replacing spreadsheets and ad-hoc workflows with robust, repeatable jobs.
• Build performance dashboards and reports in Streamlit and HTMX (FastAPI) that Finance, Asset Management, and Fund Management actually use.
• Integrate internal and third-party systems via REST APIs, improving data accessibility across the business.
• Champion data quality – implement validation, monitoring, and governance practices that give stakeholders confidence in the numbers.
• Collaborate directly with non-technical teams to understand their problems and translate them into data solutions.

Skills

SQL

Python

Databricks

Git/GitHub

Data modelling

ETL/ELT

PostgreSQL

Communication

Shipping bias

Tools

Databricks

GitHub

PostgreSQL

Job description

Octopus Energy Group is seeking a Data Engineer to own data from source systems to decision-ready outputs. You will build and maintain pipelines in Databricks, model data, and contribute to dashboards and internal tools.

You’ll collaborate with investment and asset management teams, automate processes with Python, and integrate systems via REST APIs to improve data access and quality across the business.