Data Engineer: AI-Powered Data Pipelines & Dashboards

Jackalope Digital LLC; Greater London; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

Octopus Energy Group's OEGEN Data, Tech & Transformation Team is seeking a Data Engineer to own the journey of data from source systems to decision-ready outputs. You’ll build and maintain pipelines, model data, stand up dashboards, and integrate systems via APIs.

In a team this size you’ll also contribute to internal tools using Python and Streamlit for rapid data access. Within your first 3 months you’ll take ownership of at least one critical pipeline into Databricks and improve a reporting

Qualifications

• Strong SQL and Python skills used for pipeline development and automation.
• Experience with modern data stack tooling: a cloud data platform (Databricks preferred) and version control.
• Solid understanding of data modelling, warehousing patterns, and ETL/ELT design.
• Comfort working with Postgres or similar relational databases.
• Clear communication to explain data models to fund managers and engineers.
• Bias toward shipping: iterate to get things working.

Responsibilities

• Design, build, and maintain scalable data pipelines in Databricks, ensuring data is reliable and well-documented.
• Own and evolve Databricks models, define schemas, enforce testing, and keep the warehouse clean.
• Automate manual data processes using Python, replacing spreadsheets with robust jobs.
• Build dashboards and reports in Streamlit and HTMX (FastAPI) used by Finance and Asset Management.
• Integrate internal and third-party systems via REST APIs to improve data accessibility.
• Champion data quality with validation, monitoring, and governance practices.
• Collaborate with non-technical teams to translate problems into data solutions.

Skills

SQL

Python

Databricks

REST APIs

Data modelling

Tools

Git/GitHub

PostgreSQL

Job description

Octopus Energy Group's OEGEN Data, Tech & Transformation Team is seeking a Data Engineer to own the journey of data from source systems to decision-ready outputs. You’ll build and maintain pipelines, model data, stand up dashboards, and integrate systems via APIs.

In a team this size you’ll also contribute to internal tools using Python and Streamlit for rapid data access. Within your first 3 months you’ll take ownership of at least one critical pipeline into Databricks and improve a reporting