Data Engineer (Energy Markets)

Octopus Energy Group; Greater London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A global energy leader in Greater London is seeking a Data Engineer to join the Energy Markets Engineering team. The role involves building efficient databases, APIs, and pipelines to ensure smooth critical processes such as forecasting and trading. Ideal candidates will possess strong skills in SQL, Python, and Airflow, and will work on innovative projects that promote a cleaner energy future. This position embraces flexibility with a hybrid work model and a culture centered around empowerment and inclusivity.

Benefits

Flexible working hours

Unique company culture

Employee rewards and recognition

Qualifications

• Strong aptitude with SQL, Python, and Airflow essential.
• Experience building efficient, scalable databases and APIs is a huge plus.
• Experience in Kubernetes, Docker, and Spark is a huge plus.

Responsibilities

• Maintaining and developing critical data applications.
• Growing self-service application monitoring tools.
• Supporting Energy Markets teams to design and build pipelines.

Skills

SQL

Python

Airflow

Kubernetes

Docker

Spark

Data Visualization

DataOps

Tools

Django

FastAPI

Postgres

Aurora

Databricks

CircleCI

Terraform

Notion

Job description

Octopus Energy is a global energy leader revolutionising the way people use energy. We're not just an energy supplier; we're a tech company building a cleaner, smarter energy future.

The Global Energy Markets team makes sure we always have the electricity and gas we need to power our customers’ homes and businesses, while also supporting the grid to accelerate the transition to Net Zero.

To deliver on this mission, we are looking for a Data Engineer to join the Energy Markets Engineering team and help us build efficient databases, APIs, pipelines and applications to ensure critical forecasting, trading, risk and PPA processes continue to run like clockwork.

This is a chance to take on a role that blends complex data engineering, platform infrastructure, and business-critical problem-solving, all while helping transform the energy industry for the better.

What you will be doing...

• Maintaining and developing our critical data applications - scoping and implementing architectural improvements for long-term global scalability and robustness;
• Growing our suite of self-service application monitoring tools and alerts to help team members debug live issues and understand historic root causes;
• Supporting different Energy Markets teams to design and build key operational and reporting pipelines and dashboards across all Octopus Energy global regions;
• Setting up and maintaining processes for capturing, preparing and loading valuable new data into the data lake;
• Working with international teams across the Octopus Energy Group to ensure everyone shares the best practises and code is standardised where possible;
• Taking ownership of data platform improvements that enhance the capabilities for all Energy Markets teams and drives trust in the stability of the setup.

What you'll have...

• Strong aptitude with SQL, Python and Airflow essential;
• Experience building efficient, scalable databases and APIs (e.g. Django, FastAPI) a huge plus;
• Experience in Kubernetes, Docker, Spark and related monitoring tools (e.g. DataDog, Grafana, Prometheus) for DataOps a huge plus;
• Experience with dbt for pipeline modelling also beneficial;
• Skilled at shaping needs into a solid set of requirements and designing scalable solutions to meet them;
• Able to quickly understand new domain areas and visualise data effectively;
• Team player excited at the idea of ownership across lots of different projects and tools;
• Passion for driving towards Net Zero;
• Drives knowledge sharing and documentation for a more effective platform;
• Open to travelling to Octopus offices across Europe and the US.

Our data stack...

• Python as our main programming language
• Databricks Spark for data processing
• Databricks/dbt/SQL for data modelling and analytics
• Streamlit for data applications and visualisations
• Airflow for job scheduling and tracking
• CircleCI for continuous deployment
• Parquet and Delta file formats on S3 for data lake storage
• Terraform for our infrastructure definition
• Kubernetes for data services and task orchestration
• Datadog/Grafana/Prometheus for platform monitoring
• Django for custom databases and frameworks
• Postgres / Aurora for our relational databases
• Notion for documentation

💚 Why else you'll love it here 💚

• 💰 Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!
• 🎉 Octopus Energy Group is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we were voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people. We’ve also been placed in the top 10 companies for senior leadership
• 🎁 Visit our UK perks hub

For this role we are looking for someone who would be happy to work in the London office 2-3 days a week.

Our process usually takes up to 4 weeks, but we’ll always do our best to flex around what works for you. Along the way, you’ll chat with our recruitment team and your Recruiter will help you throughout different stages. Got any burning questions before then? Drop us a message at [e-mail] and we’d love to help!

If this sounds like you then we'd love to hear from you.🚀

Are you ready for a career with us? We want to ensure you have all the tools and environment you need to unleash your potential. Need any specific accommodations? Whether you require specific accommodations or have a unique preference, let us know, and we'll do what we can to customise your interview process for comfort and maximum magic!

Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.