Data Engineering Lead

SLR Consulting; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Company pension

Healthcare

Travel insurance

Life insurance

Hybrid working

Job summary

SLR Consulting is seeking a Data Engineering Lead to provide technical and operational leadership for our data engineering capability. You will lead the design and evolution of the data platform, ensure scalable pipelines, and govern data assets to support enterprise reporting, analytics, and AI initiatives.

You will mentor engineers, set engineering standards (CI/CD, testing, IaC), and work with analytics and business stakeholders to translate priorities into scalable solutions.

Qualifications

• Significant experience leading the design, development, and operation of enterprise‑scale data engineering platforms and teams.
• Strong technical expertise in SQL and Python, PySpark, or equivalent technologies for data ingestion, transformation, and validation.
• Experience with Microsoft Fabric or similar modern cloud‑based analytics and data platforms.
• Strong experience designing and governing analytical data models using recognised patterns such as Medallion Architecture, star schema, and snowflake schema.
• Experience leading technical teams, mentoring engineers, and establishing engineering standards and delivery practices.
• Experience developing and implementing data quality, monitoring, governance, security, and operational controls at scale.
• Strong understanding of software engineering principles, including CI/CD, testing, version control, and automation.
• Ability to communicate effectively with senior technical and non‑technical stakeholders and influence decision‑making.
• Experience balancing strategic planning with hands‑on technical leadership and delivery.

Responsibilities

• Oversee the design, development, and operation of data pipelines, transformation frameworks, and curated analytical datasets.
• Ensure robust implementation of data quality, monitoring, observability, operational controls, and governance requirements.
• Lead the delivery of scalable data integration solutions across APIs, event‑driven architectures, batch processing, and file‑based integration patterns.
• Establish and govern engineering practices including CI/CD, automated testing, version control, infrastructure‑as‑code, and technical documentation.
• Drive platform performance, reliability, maintainability, and cost optimisation initiatives.
• Work closely with analytics, BI, and business stakeholders to translate priorities into scalable engineering solutions.
• Help shape the enterprise data roadmap and prioritise investments that maximise business value.
• Participate in strategic planning and provide input into data governance, operating models, and capability development.
• Champion data‑driven decision‑making and promote the adoption of trusted, well‑governed data assets across the organisation.

Skills

Data platform leadership

SQL

Python

PySpark

Data governance

CI/CD

Communication

Tools

Microsoft Fabric

Job description

Job Summary

We’re looking for a Data Engineering Lead to provide technical and operational leadership for our data engineering capability, ensuring the platforms, pipelines, and data assets that underpin enterprise reporting and analytics are scalable, trusted, and aligned with long‑term business needs. This role combines hands‑on technical leadership with strategic ownership of the data engineering function. You will lead the design and evolution of the data engineering ecosystem, enforce engineering standards and best practices, and guide the delivery of high‑quality data solutions across the organisation. You’ll work closely with analytics, BI, platform, and business stakeholders to ensure that data is managed as a strategic asset, and that the data platform continues to evolve in support of growing reporting, analytics, digital, and AI‑driven use cases.

Key Responsibilities

• Data Engineering Leadership Own the design and evolution of the enterprise data platform, ensuring it supports current reporting requirements and future analytics, AI, and digital capabilities.
• Partner with enterprise and solution architects to align data engineering solutions with wider technology strategy and architecture standards.
• Drive adoption of modern data architecture approaches, including lakehouse and warehouse patterns, data product thinking, and reusable engineering services.
• Mentor and support data engineers through technical coaching, knowledge sharing, and career development activities.
• Evaluate and recommend new technologies, tooling, and approaches that improve efficiency, reliability, and scalability.

Delivery & Engineering Excellence

• Oversee the design, development, and operation of data pipelines, transformation frameworks, and curated analytical datasets.
• Ensure robust implementation of data quality, monitoring, observability, operational controls, and governance requirements.
• Lead the delivery of scalable data integration solutions across APIs, event‑driven architectures, batch processing, and file‑based integration patterns.
• Establish and govern engineering practices including CI/CD, automated testing, version control, infrastructure‑as‑code, and technical documentation.
• Drive platform performance, reliability, maintainability, and cost optimisation initiatives.

Stakeholder Engagement & Data Strategy

• Work closely with analytics, BI, and business stakeholders to understand priorities and translate them into scalable engineering solutions.
• Help shape the enterprise data roadmap and prioritise investments that maximise business value.
• Participate in strategic planning and provide input into data governance, operating models, and capability development.
• Champion data‑driven decision‑making and promote the adoption of trusted, well‑governed data assets across the organisation.

What We’re Looking For

Essential Experience / Skills

• Significant experience leading the design, development, and operation of enterprise‑scale data engineering platforms and teams.
• Strong technical expertise in SQL and Python, PySpark, or equivalent technologies for data ingestion, transformation, and validation.
• Experience with Microsoft Fabric or similar modern cloud‑based analytics and data platforms.
• Strong experience designing and governing analytical data models using recognised patterns such as Medallion Architecture, star schema, and snowflake schema.
• Experience leading technical teams, mentoring engineers, and establishing engineering standards and delivery practices.
• Experience developing and implementing data quality, monitoring, governance, security, and operational controls at scale.
• Strong understanding of software engineering principles, including CI/CD, testing, version control, and automation.
• Ability to communicate effectively with senior technical and non‑technical stakeholders and influence decision‑making.
• Experience balancing strategic planning with hands‑on technical leadership and delivery.

Desirable Experience / Skills

• Experience with enterprise business systems such as ERP, HR, and CRM platforms.
• Experience defining data platform roadmaps and leading platform transformation initiatives.
• Experience supporting enterprise reporting and analytics environments with strong governance and regulatory requirements.
• Familiarity with business‑critical domains such as finance, operations, commercial, or people data.
• Experience supporting data platforms intended to enable advanced analytics, machine learning, or AI use cases.
• Experience operating within a product‑based or data‑product delivery model.

Why Join / Opportunity

• Lead the evolution of a strategically important enterprise data platform.
• Shape the future direction of data engineering within a growing analytics & AI capability.
• Influence architecture, technology choices, engineering standards, and delivery practices across the organisation.
• Develop a high‑performing data engineering function with clear ownership and impact.
• Work with senior stakeholders to drive meaningful business outcomes through trusted and scalable data solutions.
• Help establish the foundations required to support future analytics, AI, and wider digital transformation initiatives.
• Create a lasting engineering capability that enables the organisation to make better decisions through data.

About us

SLR are global leaders in Sustainability Solutions, helping our clients achieve their sustainability goals. We are a consultancy with 4000+ employees across 6 regions in over 125 countries. Our ‘one team’ culture is at the heart of our business, providing a collaborative and supportive environment for professional development. Along with competitive salaries, our staff enjoy a comprehensive benefits package with a company pension plus excellent healthcare offering, travel and life insurance and a structured career framework with regular reviews offering outstanding opportunities for progression.

Alongside 25 day’s annual leave, with additional flexible bank holidays, we offer flexible, agile and hybrid working which enables staff to tailor hours worked around core hours, with family friendly policies help balance the needs of professional and home life.

We’re Making Sustainability Happen. We don’t have all the answers to the complex sustainability challenges faced by humanity today. But we’re working on it. We are a consultancy with 4,500+ employees, working on projects in over 125 countries around the world. When you join SLR, you’ll work alongside some of the world’s leading advisors and technicians on projects of global importance in the environmental space. We know sustainability starts from within. And no matter how good we are today, we can always do better. We continually work on our internal ethics to set the standard for organisations and reflect the advice we give to clients.