Lead Data Engineer - DaaS Platform & Pipelines

National Highways; Guildford; Hybrid; GBP 70,000 - 100,000; Full time

Job summary

National Highways is hiring a Lead Data Engineer to design, build and operate scalable data pipelines for the DaaS platform. You will collaborate with stakeholders to turn complex data into trusted, well-governed data products and insights across the organisation.

The role emphasizes DevOps practices, data governance, and a strong focus on enabling analytics via Databricks, Power BI, and ThoughtSpot, with hybrid work requiring two days per week in the office.

Qualifications

• Experience communicating with non-technical stakeholders to gather requirements and translate complex data concepts.
• Ability to understand complex datasets, source systems design, and describe them via data modelling.
• Experience designing, building, testing, and supporting moderate to complex data pipelines in a DevOps environment.
• Strong understanding of the development lifecycle and managing stakeholder delivery expectations.
• Awareness of emergent technologies and experience with the described tech stack.

Responsibilities

• Deliver the Data as a Service (DaaS) roadmap, improving trust in data, building data products, and strengthening the enterprise data platform.
• Design, build, and operate scalable data pipelines from operational systems into DaaS, using Azure DevOps, Databricks, and Azure services.
• Translate analytical and reporting needs into robust data products using Databricks workspaces, Power BI, and ThoughtSpot.
• Embed data governance, quality, and assurance across the data lifecycle, ensuring policy compliance, metadata management, and data quality.
• Define, embed, and champion data engineering best practices across the organisation.

Skills

Data pipelines

DevOps

Stakeholder comms

Data modeling

Azure

Tools

Databricks

Azure Data Factory

Power BI

ThoughtSpot

Unity Catalog

Microsoft Purview

Job description

National Highways is hiring a Lead Data Engineer to design, build and operate scalable data pipelines for the DaaS platform. You will collaborate with stakeholders to turn complex data into trusted, well-governed data products and insights across the organisation.

The role emphasizes DevOps practices, data governance, and a strong focus on enabling analytics via Databricks, Power BI, and ThoughtSpot, with hybrid work requiring two days per week in the office.