Lead Data Engineer

Serco Limited

Metropolitan Borough of Solihull, Greater London, Hook

Hybrid

GBP 75.000 - 85.000

Vollzeit

Vor 10 Tagen

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Company car
Bonus scheme
Private medical insurance
Flexible working
Pension 6%
Career development
Serco discounts
Employee assistance

Zusammenfassung

Serco Limited is seeking a Lead Data Engineer to act as the technical authority for data engineering, driving architecture, standards, and delivery across a modern multi-cloud ecosystem spanning Azure, AWS, and Databricks.

You will spend around 80% of your time hands-on, designing and building enterprise-scale data solutions, with the remaining 20% leading people, influencing stakeholders, and shaping data engineering practices across the organisation.

Qualifikationen

  • Expert-level PySpark and SQL with performance optimisation.
  • Strong data modelling and large-scale integration design experience.
  • Proven ability to embed testing, observability, and data quality controls.
  • Deep hands-on Databricks experience including lakehouse architecture and streaming.
  • Broad cloud expertise across Azure and AWS with multi-cloud delivery.

Aufgaben

  • Define and enforce data engineering standards, patterns and best practices across the organisation.
  • Architect and deliver scalable, resilient data solutions across Azure, AWS and Databricks.
  • Lead complex engineering workstreams and guide technical decisions to ensure high-quality delivery.
  • Design and govern enterprise data models, including lakehouse strategies and schema evolution.
  • Champion Databricks as the core data platform and drive multi-cloud strategy.

Kenntnisse

PySpark
SQL
Data modeling
CI/CD for data
Multi-cloud
Mentoring
Leadership

Tools

Databricks
Azure
AWS
Delta Lake
Unity Catalog
Structured Streaming
MLflow

Jobbeschreibung

Lead Data Engineer
Hybrid - Attached to our Solihull, London or Hook office
Full Time, Permanent

Band 3 / £75,000 - £85,000 (dependent on experience)

Here at Serco, we're looking for a Lead Data Engineer to act as the technical authority for data engineering, driving architecture, standards, and delivery across a modern multi-cloud ecosystem spanning Azure, AWS, and Databricks.

You'll spend around 80% of your time hands-on, designing and building complex, enterprise-scale data solutions. The remaining 20% is just as critical: leading people, influencing stakeholders, and shaping how data engineering operates across the organisation.

Databricks sits at the heart of our platform - this role requires someone who can deeply leverage the Databricks to enable scalable analytics, data science, and AI use cases across the business.

As part of this you’ll:

Define and enforce data engineering standards, patterns, and best practices across the organisation.

Architect and deliver scalable, resilient data solutions across Azure, AWS, and Databricks, ensuring enterprise-grade performance and reliability.

Lead complex engineering workstreams - unblocking teams, guiding technical decisions, and ensuring high-quality delivery outcomes.

Design and govern enterprise data models (conceptual, logical, and physical), including lakehouse zone strategies and schema evolution approaches.

Champion Databricks as the core data platform, leveraging lakehouse architecture, Unity Catalog, Delta Live Tables, Structured Streaming, and MLflow.

Drive a consistent multi-cloud Databricks strategy, enabling scalable and interoperable data platforms across environments.

Optimise performance across pipelines, compute, storage, and orchestration frameworks, embedding cost-efficiency and scalability.

Define and implement CI/CD for data platforms, supporting automated testing, secure deployments, and multi-environment promotion.

Embed robust data governance, security, and lifecycle controls, ensuring compliance through classification, encryption, access management, and lineage frameworks (e.g., Unity Catalog, Purview, Lake Formation).

Act as a senior SME for troubleshooting complex issues, leading root-cause analysis and long-term remediation of data quality and platform challenges.

Lead, mentor, and grow a community of Data Engineers, driving technical excellence through coaching, reviews, and knowledge sharing.

Operate effectively across a matrix organisation, influencing architecture, cyber, product, and senior stakeholders.

Communicate complex technical concepts clearly, articulating trade-offs, risks, and strategic decisions to both technical and non-technical audiences.

What you’ll need to do the role:

Expert-level experience in enterprise-scale data engineering, including defining standards, patterns, and overseeing complex delivery.

Advanced proficiency in PySpark and SQL, with deep expertise in performance optimisation and scalable data processing.

Strong experience in data modelling and large-scale data integration design, with the ability to build robust, maintainable, and testable pipelines.

Proven ability to embed testing frameworks, observability, and data quality controls across engineering workflows.

Deep hands-on experience with Databricks (essential), including lakehouse architecture, Delta Lake, Unity Catalog, and streaming technologies.

Broad cloud expertise across Azure (Synapse, ADF, Event Hub, ADLS Gen2, Purview, Key Vault) and AWS (S3, Glue, EMR, Kinesis, Athena, Lake Formation, IAM), with strong multi-cloud experience.

Strong understanding of modern engineering practices, including CI/CD for data platforms, automated deployment pipelines, and environment promotion strategies.

Experience designing monitoring, observability, and cost optimisation frameworks, alongside governance, lineage, cataloguing, and compliance at scale.

Excellent stakeholder management skills, with the ability to influence senior leaders and work effectively across matrixed organisations.

Proven leadership capability, including mentoring, coaching, and developing engineering teams.

Strong communication skills, with the ability to translate complex technical concepts into clear business value.

8+ years' experience in data engineering within enterprise environments.

Relevant certifications (desirable), such as Azure Data Engineer Associate, AWS Data Analytics Specialty, or Databricks Data Engineer (Associate/Professional).

SC clearance (or willingness to obtain it)

What we offer:

Company car

5% on target bonus scheme

Private medical insurance

Flexible working considered

Pension - 6%

Chance to contribute to innovation in the public services

A company passionate about diversity and inclusion

Serco discounts which include cinema, merlin entertainment and online shopping discounts, and discounts on mobile phone plans and leisure centre memberships.

A range of benefits to support the health and wellbeing of you and your family such as Employee Assistance Programme, Simply Health Cash Plans, and more.

A wealth of career development training to suit your future aspirations. These range from role specific training, leadership coaching, formal study and much more to support you to build your career with Serco.

A safe and supportive culture.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Lead Data Engineer
Lead Data Engineer

Serco Group Plc • Metropolitan Borough of Solihull

Hybrid
GBP 75.000 - 85.000
Private medical insurance
Flexible working considered
Pension – 6%
+1
Lead Data Engineer
Lead Data Engineer

Serco Group Plc • Manor Park

Hybrid
GBP 120.000 - 150.000
Discounts on cinema
Merlin entertainment discounts
Online shopping discounts
+2
Lead Data Engineer
Lead Data Engineer

Serco Group Plc • Hook

Hybrid
GBP 90.000 - 120.000
Hybrid working
Employee discounts
Career development opportunities
+1
Lead Data Engineer
Lead Data Engineer

Serco • Metropolitan Borough of Solihull, Greater London, Hook

Hybrid
GBP 75.000 - 85.000
Company car
5% on target bonus scheme
Private medical insurance
+7
Lead Data Engineer
Lead Data Engineer

Serco Plc • Metropolitan Borough of Solihull, Greater London, Hook

Hybrid
GBP 75.000 - 85.000
Company car
5% on target bonus scheme
Private medical insurance
+2
Analytics Engineer
Analytics Engineer

Serco • Metropolitan Borough of Solihull

Hybrid
GBP 40.000 - 50.000
Pension 6% employer matched
Annual leave 25 days + bank holidays
Life assurance 2x base salary
+1
Data Engineering Lead
Data Engineering Lead

DAC Beachcroft LLP • Greater London

Hybrid
GBP 90.000 - 140.000
Private medical insurance
Income protection insurance
Gym membership
Data Engineering Lead
Data Engineering Lead

DAC Beachcroft LLP • City Of London

Vor Ort
GBP 90.000 - 130.000
Private medical insurance
Income protection insurance
Discounted gym membership
+1
Senior Data Engineer
Senior Data Engineer

Langham Recruitment • Risley

Hybrid
GBP 54.000 - 66.000
Private healthcare
Car allowance
Hybrid working
+2
Data Engineering Lead
Data Engineering Lead

Artis Recruitment • West of England

Hybrid
GBP 77.000 - 94.000
Hybrid working
Excellent career development
Healthcare and wellbeing
+2