Data Platform Engineer – AI/ML & Pipelines

Octopus Energy; Greater London; Hybrid; Full time

Benefits offered by this job

Flexible salary discussion

Dog-friendly office

Strong company culture

Job summary

An innovative electric vehicle company is seeking an experienced Data Engineer to build and optimize their data platform, transforming raw data into actionable business insights. You will develop data sources and pipelines while collaborating closely with stakeholders. Passion for decarbonisation and high-quality code writing is crucial. If you thrive in a fast-paced environment and are eager to make a sustainable impact, we encourage you to apply. You will work with a supportive team dedicated to technological innovation.

Qualifications

• Experience with distributed data processing.
• Experience with monitoring, testing, and ensuring data quality.
• Ability to work autonomously and manage problems end-to-end.

Responsibilities

• Build and optimize the data platform for business insights.
• Develop new data sources and pipelines integrating third-party systems.
• Collaborate with stakeholders to scope new projects.

Skills

Passion for decarbonisation

High quality code writing

Distributed data processing

Monitoring and testing

Robust pipeline construction

Governance

Tools

Airflow

AWS

Kubernetes

Spark & distributed computing

dbt

Terraform

Databricks

MLOps implementation

Job description

An innovative electric vehicle company is seeking an experienced Data Engineer to build and optimize their data platform, transforming raw data into actionable business insights. You will develop data sources and pipelines while collaborating closely with stakeholders. Passion for decarbonisation and high-quality code writing is crucial. If you thrive in a fast-paced environment and are eager to make a sustainable impact, we encourage you to apply. You will work with a supportive team dedicated to technological innovation.