Data Engineer: AI-Driven Pipelines & Dashboards

Octopus Energy Group; Greater London; Híbrido; GBP 65 000 - 95 000; Tempo integral

Resumo da oferta

Octopus Energy Group is expanding its OEGEN Data, Tech & Transformation Team in Greater London. We’re seeking a Data Engineer to own data journeys from source systems to decision-ready outputs.

You’ll build and maintain pipelines, model data, and deploy internal tools with Streamlit, FastAPI, or HTMX to empower Investment and Asset Management teams. In the first months you’ll take ownership of critical Pipelines into Databricks and contribute to reporting layers used by Fund and Asset

Qualificações

• Strong SQL and Python skills used for pipeline development, data modelling, and automation.
• Experience with modern data stack tooling, cloud data platform (Databricks preferred), and version control (Git/GitHub).
• Solid understanding of data modelling, warehousing patterns, and ETL/ELT design.
• Comfortable with Postgres or similar relational databases.

Responsabilidades

• Design, build, and maintain scalable data pipelines in Databricks, ensuring data is reliable, timely, and well-documented.
• Own and evolve Databricks models – define schemas, enforce testing, and keep the warehouse clean.
• Automate manual data processes using Python, replacing spreadsheets and ad-hoc workflows with robust, repeatable jobs.
• Build dashboards and reports in Streamlit and HTMX (FastAPI) that Finance, Asset Management, and Fund Management actually use.
• Integrate internal and third-party systems via REST APIs, improving data accessibility across the business.
• Champion data quality – implement validation, monitoring, and governance practices for stakeholder confidence.
• Collaborate with non-technical teams to translate problems into data solutions.

Conhecimentos

SQL

Python

Databricks

Git/GitHub

Data modelling

ETL/ELT

Ferramentas

Databricks

PostgreSQL

Descrição da oferta de emprego

Octopus Energy Group is expanding its OEGEN Data, Tech & Transformation Team in Greater London. We’re seeking a Data Engineer to own data journeys from source systems to decision-ready outputs.

You’ll build and maintain pipelines, model data, and deploy internal tools with Streamlit, FastAPI, or HTMX to empower Investment and Asset Management teams. In the first months you’ll take ownership of critical Pipelines into Databricks and contribute to reporting layers used by Fund and Asset