Data Platform Engineer

Energy Vault; London; On-site; GBP 40,000 - 70,000; Full time

Job summary

Energy Vault is seeking a passionate Data Engineer to join our dynamic team in London. In this role, you will focus on building and optimising our data platform, transforming raw data into actionable business insights while supporting pivotal projects aimed at sustainability. You will collaborate on diverse tasks, leveraging technologies like AWS and Kubernetes in a company dedicated to innovation and green energy.

Benefits

Flexible working arrangements

Employee benefits program

Opportunities for professional development

Qualifications

• Experience in AWS, Kubernetes, and Python required.
• Ability to build and optimise data platforms for business insights.
• Experience with data engineering practices and tools.

Responsibilities

• Build and optimise the data platform for transforming raw data.
• Deliver new data engineering projects with business stakeholders.
• Research and implement new tooling for data processing.

Skills

AWS

Kubernetes

Data/network security

Python

Docker

Grafana

Postgres

CDC systems

Data related products

Education

Relevant degree in Computer Science or similar

Tools

Terraform

Airflow

Circle CI

Databricks

Spark

dbt

Streamlit

Job description

Octopus Energy is all about clean, green energy with transparent pricing and a relentless commitment to customer experience. Join a global team dedicated to sustainability and green tech, where energy is good for the planet and your soul Embrace flat hierarchies and an open, agile culture that fosters innovation, flexibility, and creativity. At Octopus, great people get stuff done, all whilst being themselves.

At Octopus Energy we are passionate about building great technology to change the way customers use, and think about, energy for the good of the planet. This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero and support the energy transition.

We have developed a data platform that is used by all our businesses around the world. The platform empowers users with self-service data analytics and automates our data processing workflows, from simple ETL jobs to ML training and prediction. The Data Platform Team works on anything from natural language understanding of customer communications to processing billions of smart meter readings every day to support creating customised and market-leading smart energy tariffs.

We employ software engineering best practices to design, test, and deploy our data platform and services. We are looking for an experienced Engineer to join the team to help build and maintain the platform, pipelines, and reporting tools.

What you'll do...

• Build and optimise the platform used by the data team to transform raw data into business insights
• Scope and deliver new data engineering projects in collaboration with business stakeholders
• Develop and deploy ML infrastructure to help build out our ever-growing AI requirements and use cases
• Research and implement new tooling where appropriate, whether its developed in-house or sourced externally
• Maintain and expand our existing data infrastructure and tools.
• Consult the wider business on Engineering best practices and stay up to date with trends within the profession
• Support the internationalisation of our data infrastructure as we continue to grow globally.

What you'll have...

• Primarily, we want our DevOps engineers to have a passion for writing high quality code and building lean processes. It would be helpful to have experience/expertise/knowledge in the following (in rough priority order):

• AWS
• Kubernetes (EKS)
• Data/network security
• Python
• Docker
• Grafana
• Postgres
• CDC systems
• Data related products (airflow, jupyter, spark, etc)

The projects will be varied and we’re looking for someone who can work autonomously and proactively to scope problems and solve and deliver pragmatic solutions

Our Tech Stack...

• Python as our main programming language
• Terraform on Spacelift for our infrastructure definition and deployment
• Kubernetes for data services and task orchestration
• Airflow for job scheduling and tracking
• Circle CI for continuous deployment
• Databricks for our data lake platform
• Parquet and Delta file formats on S3 for data lake storage
• Postgres / aurora for our relational databases
• Spark for data processing
• dbt for data modelling
• SparkSQL for analytics
• Streamlit for data applications

Why else you'll love it here

• Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!
• Octopus Energy Group is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we were voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people. We’ve also been placed in the top 10 companies for senior leadership
• Visit our UK perks hub - Octopus Employee Benefits

Our process usually takes up to 4 weeks, but we’ll always do our best to flex around what works for you. Along the way, you’ll chat with our recruitment team and your Recruiter will help you throughout different stages. Got any burning questions before then? Drop us a message at [e-mail] and we’d love to help!

If this sounds like you then we'd love to hear from you.

Are you ready for a career with us? We want to ensure you have all the tools and environment you need to unleash your potential.Need any specific accommodations?Whether you require specific accommodations or have a unique preference, let us know, and we'll do what we can to customise your interview process for comfort and maximum magic!

Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.