Lead Data Engineer — DaaS Platform & Governance

National Highways; West Midlands; Hybrid; GBP 75,000 - 110,000; Full time

Job summary

National Highways is expanding its Digital Services function and recruiting Lead Data Engineers to shape data usage across England’s transport network. You will join a hybrid role with two days per week in office at National Highways locations, delivering the DaaS roadmap and building scalable data pipelines and assets.

You will collaborate with stakeholders to translate needs into trusted data products, while embedding governance, quality, and AI considerations across the data lifecycle to

Qualifications

• Experience building and deploying data pipelines and integration solutions in a collaborative delivery environment.
• Experience analysing source systems and complex datasets to create reusable data assets for analytics and reporting.
• Experience with scripting CLI, Python and SQL on enterprise data platforms in cloud environments (Azure Databricks preferred).
• Excellent communication with technical and non-technical stakeholders; ownership of delivery outcomes.

Responsibilities

• Deliver the Data as a Service (DaaS) roadmap by onboarding enterprise data and expanding analytics capabilities.
• Design, build and enhance data pipelines and data assets across diverse data domains.
• Collaborate with stakeholders to understand requirements and deliver trusted data products for operational decisions.
• Embed data governance and metadata management across the data lifecycle, including AI governance.
• Improve production pipelines' reliability, performance, and cost efficiency; promote engineering best practices.

Skills

Data pipelines

Data integration

Python

SQL

CLI

Databricks

Azure Data Factory

Unity Catalog

Tools

Databricks

Azure Data Factory

Unity Catalog

Python

SQL

Job description

National Highways is expanding its Digital Services function and recruiting Lead Data Engineers to shape data usage across England’s transport network. You will join a hybrid role with two days per week in office at National Highways locations, delivering the DaaS roadmap and building scalable data pipelines and assets.

You will collaborate with stakeholders to translate needs into trusted data products, while embedding governance, quality, and AI considerations across the data lifecycle to