Senior Data Engineer - Lead Data Pipelines (Flexible)

Government Recruitment Service; Leeds; On-site; GBP 44,000 - 53,000; Full time

Job summary

Government Recruitment Service in Leeds is seeking a Senior Data Engineer to lead the development and governance of the Insolvency Service's enterprise data architecture. You will align technology with organisational strategy, digital transformation and secure-by-design principles to support long-term capability and value for money.

Reporting to the Head of Data & Technology, you will collaborate across Microsoft Fabric, OneLake and Azure services to deliver data solutions for analytics,

Responsibilities

• design, develop and maintain complex data ingestion, transformation and integration pipelines using Microsoft Fabric, OneLake and organisational data sources
• develop reusable engineering components, trusted datasets and data products to support analytics, reporting, Azure AI and machine-learning workloads
• implement validation, reconciliation and quality controls, ensuring that data solutions meet agreed lineage, metadata, governance and security standards
• implement CI/CD, automated testing and DataOps practices, optimising pipelines for performance, scalability, resilience and cost
• monitor and troubleshoot data pipelines, lead root-cause analysis and work with development security operations (DevSecOps), artificial intelligence operations (AIOps) and Application Support to improve operational reliability
• work with data scientists, analysts, delivery teams and suppliers to translate requirements into robust solutions, supported by appropriate documentation and recovery procedures
• provide technical leadership and management support to other engineers through mentoring, peer review and technical assurance, contributing to engineering standards and continuous improvement.

Job description

Government Recruitment Service in Leeds is seeking a Senior Data Engineer to lead the development and governance of the Insolvency Service's enterprise data architecture. You will align technology with organisational strategy, digital transformation and secure-by-design principles to support long-term capability and value for money.

Reporting to the Head of Data & Technology, you will collaborate across Microsoft Fabric, OneLake and Azure services to deliver data solutions for analytics,