Lead Data Engineer in London

Energy Jobline ZR; City Of London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A dynamic technology firm is seeking a Lead Data Engineer to spearhead the design and implementation of a modern Azure-Snowflake data platform. You will play a crucial role in automating data pipelines, ensuring quality and validation during data migration, and collaborating with cross-functional teams. The ideal candidate will have substantial experience in Azure and Snowflake architecture, along with strong SQL and Python skills. This position offers a competitive day rate and a hybrid work model.

Qualifications

• Proven experience designing and building Azure-based data platforms (Data Lake, ADF, Synapse, DevOps).
• Strong expertise in Snowflake architecture, performance tuning, and optimisation.
• Fluent in SQL, Python, and data pipeline tools such as ADF, dbt, or Airflow.

Responsibilities

• Architect and deliver a scalable Azure‑Snowflake data platform.
• Build automated data pipelines using ADF, dbt, or Airflow.
• Partner with reporting specialists for clean, structured data.
• Lead data integration and migration activities from legacy systems.
• Establish data governance, security, and documentation frameworks.
• Collaborate across IT, Finance, Commercial, and Operations.

Skills

Designing Azure-based data platforms

Snowflake architecture

SQL

Python

Data pipeline tools (ADF, dbt, Airflow)

Job description

Lead Data Engineer

Location: London Office, hybrid 2 days on site

Type: Interim, Full-time

Day rate: £600 - £700 Outside IR35

Overview

Stanton House is working with a fast-growing, sustainability-focused business which is building a modern Azure‑Snowflake data platform to power its next stage of transformation. This initiative will establish a unified data backbone across Finance, Commercial, and Operations - enabling consistent, automated, and actionable insight as the organisation moves toward full technology independence in 2026.

The Opportunity

You’ll lead the end-to-end design and implementation of a modern data estate based on Azure and Snowflake, working closely with internal stakeholders across IT, Transformation, and Reporting. The goal: to have a fully live, production-ready data platform - complete with automated ingestion, medallion architecture, and Power BI integration - by early 2026.

Key Responsibilities

• Architect and deliver a scalable Azure‑Snowflake data platform.
• Build automated data pipelines using ADF, dbt, or Airflow for key systems (including ERP, HR, and operational tools).
• Partner with reporting specialists to ensure clean, structured data for Power BI dashboards and analytics.
• Lead data integration and migration activities from legacy systems, ensuring quality, validation, and sign-off.
• Establish data governance, security, and documentation frameworks for ongoing operations and audit readiness.
• Collaborate cross‑functionally across IT, Finance, Commercial, and Operations to align on data standards and architecture.

Skills needed

• Proven experience designing and building Azure‑based data platforms (Data Lake, ADF, Synapse, DevOps).
• Strong expertise in Snowflake architecture, performance tuning, and optimisation.
• Fluent in SQL, Python, and data pipeline tools such as ADF, dbt, or Airflow.
• Understanding of Power BI data modelling and DAX.
• Experience in data migration, TSA, or carve‑out projects is a strong advantage.