Hybrid Lead Data Engineer – DaaS, Pipelines & Insights

National Highways; Guildford; Hybrid; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

National Highways is expanding its Data Team with a Lead Data Engineer to design, build and operate data products that support operations and strategy. The role sits in a hybrid model requiring two days in the office at any National Highways location.

You will work with Databricks, Power BI and ThoughtSpot to onboard enterprise data, improve data trust, and deliver scalable analytics across the transport network.

Qualifications

• Experience building data pipelines and assets across diverse data sources.
• Ability to translate user needs into data products and analytics solutions.
• Proven collaboration with stakeholders to deliver trusted data services.

Responsibilities

• Deliver the DaaS roadmap by onboarding enterprise data and expanding analytics capabilities.
• Design, build and enhance data pipelines and reusable data assets across the platform.
• Collaborate with stakeholders to develop user stories and deliver trusted data products.
• Embed governance, quality and assurance across the data lifecycle with Unity Catalog.
• Maintain production pipelines for reliability, performance, and cost efficiency.
• Promote best practices and reusable engineering approaches across teams.
• Analyse source systems and complex datasets to create reusable data assets.
• Work with CLI, Python and SQL on Azure, Databricks and related data ecosystems.
• Communicate effectively with technical and non-technical stakeholders.
• Monitor and improve production data pipelines and data products.

Skills

Python

SQL

Data modeling

Stakeholder engagement

Tools

Databricks

Power BI

ThoughtSpot

Unity Catalog

Azure Data Factory

Job description

National Highways is expanding its Data Team with a Lead Data Engineer to design, build and operate data products that support operations and strategy. The role sits in a hybrid model requiring two days in the office at any National Highways location.

You will work with Databricks, Power BI and ThoughtSpot to onboard enterprise data, improve data trust, and deliver scalable analytics across the transport network.