Lead Data Engineer - DaaS & Cloud Data Pipelines (Hybrid)

LGBT Jobs; Manchester; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

National Highways is recruiting a Lead Data Engineer to advance the Digital Services function. You will design data pipelines, govern data and collaborate with stakeholders to deliver trusted data products across the organisation.

This hybrid role requires two days in the office weekly, with a focus on improving data reliability, performance and cost efficiency. You will contribute to safer, smoother journeys through enterprise data capabilities.

Qualifications

• Experience building and deploying data pipelines and data integration solutions in a collaborative delivery environment.
• Experience analysing source systems and complex datasets to create reusable data assets for analytics and reporting.
• Experience with scripting CLI, Python and SQL in enterprise cloud platforms (Azure Cloud, Databricks, Azure Data Factory).
• Ability to communicate with technical and non-technical stakeholders, manage expectations and influence data-related decisions.

Responsibilities

• Deliver the Data as a Service (DaaS) roadmap by onboarding enterprise data and expanding analytical capabilities.
• Design and enhance data pipelines, integrations and assets across transactional, asset, traffic, event, and business data.
• Collaborate with stakeholders across the organisation to develop user stories and trusted data products for operational and strategic decisions.
• Embed governance, quality and metadata management across the data lifecycle within Unity Catalog.
• Support operation and continuous improvement of production data pipelines and platform capabilities.
• Promote best practices and reusable engineering approaches across the organisation.

Skills

Data pipelines

Data integration

Python

SQL

Databricks

Azure Cloud

Unity Catalog

Power BI

ThoughtSpot

Data governance

Stakeholder communication

Tools

Databricks

Azure Data Factory

Power BI

Unity Catalog

Job description

National Highways is recruiting a Lead Data Engineer to advance the Digital Services function. You will design data pipelines, govern data and collaborate with stakeholders to deliver trusted data products across the organisation.

This hybrid role requires two days in the office weekly, with a focus on improving data reliability, performance and cost efficiency. You will contribute to safer, smoother journeys through enterprise data capabilities.