Lead Data Engineer - DaaS & Data Governance (Hybrid)

LGBT Jobs; West of England; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

National Highways is seeking a Lead Data Engineer to drive the Data as a Service roadmap and deliver trusted data products for the transport network. The role focuses on designing and enhancing data pipelines, governing data and enabling decision-making across the organisation.

The successful candidate will collaborate with stakeholders, implement enterprise data capabilities, and promote best practices in data engineering.

Qualifications

• Experience building data pipelines in a collaborative delivery environment with governance practices.
• Experience analysing source systems and complex datasets to support analytics and reporting.
• Proficiency with Python and SQL against enterprise data platforms and cloud ecosystems (Azure Databricks, Unity Catalog preferred).
• Strong communication with technical and non-technical stakeholders, owning delivery outcomes.
• Experience operating and improving production data pipelines and data products, including monitoring and cost optimization.

Responsibilities

• Deliver the Data as a Service (DaaS) roadmap by onboarding enterprise data and expanding analytical capabilities.
• Design, build and enhance data pipelines, integrations and reusable data assets across transactional, asset, traffic, event and business data.
• Collaborate with stakeholders to understand analytical needs, develop user stories and deliver trusted data products for operational and strategic decisions.
• Embed governance, quality and assurance across the data lifecycle, ensuring policy compliance and metadata management (Unity Catalog).
• Support operation and continuous improvement of production data pipelines and platform capabilities for reliability and cost efficiency.
• Promote best practices and reusable engineering approaches across the organisation.

Skills

Data pipelines

Data governance

Python

SQL

Cloud platforms

Tools

Databricks

Power BI

ThoughtSpot

Unity Catalog

Azure Data Factory

Azure Cloud

Job description

National Highways is seeking a Lead Data Engineer to drive the Data as a Service roadmap and deliver trusted data products for the transport network. The role focuses on designing and enhancing data pipelines, governing data and enabling decision-making across the organisation.

The successful candidate will collaborate with stakeholders, implement enterprise data capabilities, and promote best practices in data engineering.