Staff Data Engineer - Analytics Platform

Octopus Energy Ltd; City of Westminster; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading energy provider in the UK is seeking an analytics specialist to build and document data models and establish a testing framework using dbt and various BI tools. You will work on creating robust CI/CD pipelines and monitoring tools to improve analytics for all global businesses. Candidates should have deep expertise with dbt Core, advanced SQL skills, and experience in data modeling techniques. This role offers a chance to shape analytics at a rapidly growing company.

Qualifications

• Deep expertise with dbt Core and Git.
• Advanced experience with SQL and Jinja.
• Knowledge of Data Modelling Techniques.

Responsibilities

• Build and document analytics models using dbt.
• Create dashboards and charts with modern BI tools.
• Establish comprehensive testing frameworks for data quality.

Skills

dbt Core

SQL

Jinja

Data Modelling Techniques

Cloud warehousing

Tools

GitHub

Lightdash

Elementary

CircleCI

Databricks

Airflow

Kubernetes

DuckDB

Spark

Job description

Producers & Consumers

• Producers can build efficient pipelines from source data to insight with ease
• Producers can scale out Modelling & BI to any number of Octopus Energy businesses around the world
• Producers can provide insight via:
  • Notebooks for detailed storytelling
  • Dashboards for live updates on a domain
  • Consumers can find what they're looking for with ease
  • Consumers have trust in the metrics and dashboards they're presented with
  • Consumers can self-serve if needed
  • Consumers can retrieve data via automation

What You'll Do

• Build, document and consult on:
  • Using dbt to model analytics for business domains using a data mesh framework.
  • Charts and dashboards using modern BI tools
  • Comprehensive testing frameworks using tools like dbt_expectation and elementary to ensure data quality
  • Data governance and documentation strategy to improve data discoverability and drive a consistent approach across teams
  • Build robust CI/CD pipelines for testing and deployment of AE and BI models.
  • Build monitoring and alerting tools for gathering insight on AE performance
  • Tools: GitHub, Lightdash, Elementary, CircleCI, Databricks, Airflow, Kubernetes, DuckDB, Spark

Qualifications

• Deep expertise with dbt Core and Git
• Advanced experience with SQL
• Advanced experience with Jinja
• Data Modelling Techniques e.g. Kimball, OBT
• Experience with a cloud warehousing provider e.g. Databricks, GCP, Snowflake

Company Overview

Over the past ten years, Octopus Energy Group has expanded from a UK startup to become the UK's largest energy provider and a global leader, serving over 10 million customers across 8 countries.

The Analytics Platform team is brand new to the company and is tasked with consolidating analytics tooling and building a strategy for consistent data modelling across all our global businesses.