Senior Data Engineer - Build Scalable Data Pipelines & ML

Worklane GmbH; Greater London; On-site; GBP 85,000 - 120,000; Full time

Job summary

Octopus Electric Vehicles, part of the Octopus Energy Group, is hiring a Senior Data Engineer to own and optimise our data platform, build pipelines and ML infrastructure, and collaborate across teams to accelerate our green transportation mission.

You will work on scalable data systems, ingest through APIs, and drive data quality and governance as we expand our analytics capabilities in the UK market.

Qualifications

• Experience with distributed data processing.
• Experience with monitoring, testing, and data quality.
• Experience building robust pipelines from diverse sources (parquet, SQL & no-SQL databases, API endpoints).
• A passion for decarbonisation and writing high quality code.

Responsibilities

• Own and optimise our platform architecture (improve reliability, scalability, maintainability, etc).
• Build new data sources and data pipelines that deliver key data and insights to the business (integration with third party systems and ingestion through APIs).
• Scope and deliver new data engineering projects in collaboration with business stakeholders.
• Develop and deploy ML infrastructure to support AI requirements and use cases.
• Collaborate with dev teams to build seamless integrations between back-end databases and the data platform.
• Shape the direction of the growing team and coach team members on best practices.

Skills

Python

AWS

Kubernetes

Spark

dbt

Terraform

Data Warehousing

Databricks

MLOps

Airflow

Governance

APIs

Parquet

SQL

No-SQL

Job description

Octopus Electric Vehicles, part of the Octopus Energy Group, is hiring a Senior Data Engineer to own and optimise our data platform, build pipelines and ML infrastructure, and collaborate across teams to accelerate our green transportation mission.

You will work on scalable data systems, ingest through APIs, and drive data quality and governance as we expand our analytics capabilities in the UK market.