Lead Data Engineer - DaaS, Pipelines & Platforms

National Highways; Birmingham; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

National Highways is expanding its Data Team to deliver secure and scalable data products across the transport network. This hybrid role involves partnering with stakeholders to design and deploy data pipelines that power analytics with Databricks, Power BI and ThoughtSpot.

You’ll champion data governance and optimise production pipelines for reliability and cost efficiency. The successful candidate will work across the organisation, shaping data strategy and ensuring data assets meet

Qualifications

• Proven experience building and deploying data pipelines and data integration solutions.
• Strong SQL and Python skills with enterprise data platforms.
• Experience with cloud data ecosystems (Azure) and data governance practices.

Responsibilities

• Deliver the Data as a Service (DaaS) roadmap by onboarding enterprise data and expanding analytical capabilities.
• Design, build and enhance data pipelines and reusable data assets across diverse data domains.
• Collaborate with stakeholders to translate analytical needs into data products and user stories.
• Embed data governance and quality across the data lifecycle, including metadata management.
• Maintain production data pipelines for reliability, performance and cost efficiency.
• Promote best practices, automation, testing and governance in development lifecycles.

Skills

Lead data engineering

Stakeholder collaboration

Python

SQL

Data modelling

Data governance

CLI scripting

Tools

Databricks

Power BI

ThoughtSpot

Azure Data Factory

Unity Catalog

Job description

National Highways is expanding its Data Team to deliver secure and scalable data products across the transport network. This hybrid role involves partnering with stakeholders to design and deploy data pipelines that power analytics with Databricks, Power BI and ThoughtSpot.

You’ll champion data governance and optimise production pipelines for reliability and cost efficiency. The successful candidate will work across the organisation, shaping data strategy and ensuring data assets meet