Hybrid Lead Data Engineer - DaaS & Governance

LGBT Jobs; Bedford; Hybrid; GBP 70,000 - 95,000; Full time

Job summary

National Highways is recruiting Lead Data Engineers as part of its Digital Services function. This hybrid role requires two days per week in the office at any National Highways location.

You will lead the design, development and delivery of data products that underpin safer and more reliable journeys across the UK transport network. You will work with stakeholders to translate user needs into scalable data solutions, driving governance, quality and performance across production pipelines using

Qualifications

• Experience building and deploying data pipelines and data integration solutions within a collaborative delivery environment.
• Experience analysing source systems and complex datasets for analytics and reporting.
• Experience with Python and SQL on enterprise data platforms and cloud-based data ecosystems.

Responsibilities

• Deliver the Data as a Service (DaaS) roadmap by onboarding enterprise data and expanding analytical capabilities.
• Design, build and enhance data pipelines and reusable data assets across the DaaS platform.
• Collaborate with stakeholders to understand needs, develop user stories and deliver trusted data products for operational and strategic decisions.
• Embed data governance, quality and assurance across the data lifecycle including metadata management.
• Support operation and continuous improvement of production data pipelines and platform capabilities.
• Promote data engineering best practices and reuse across the organisation.

Skills

Data pipelines

Data integration

Python

SQL

Stakeholder collaboration

Cloud platforms

Tools

Databricks

Power BI

ThoughtSpot

Azure Data Factory

Unity Catalog

Job description

National Highways is recruiting Lead Data Engineers as part of its Digital Services function. This hybrid role requires two days per week in the office at any National Highways location.

You will lead the design, development and delivery of data products that underpin safer and more reliable journeys across the UK transport network. You will work with stakeholders to translate user needs into scalable data solutions, driving governance, quality and performance across production pipelines using