Senior Data Engineer - Lead Enterprise Data & AI

Government Recruitment Service; Newcastle upon Tyne; On-site; GBP 44,000 - 53,000; Full time

Benefits offered by this job

Disability Confident employer scheme

Job summary

Government Recruitment Service in Newcastle-upon-Tyne is seeking a Senior Data Engineer to lead the development and governance of our enterprise data architecture, aligning technology with organisational strategy, digital transformation and secure-by-design principles. Your work will support long-term capability, resilience and value for money, creating a modern, sustainable service.

You will work across Microsoft Fabric, OneLake and Azure services to develop secure, governed data solutions,

Qualifications

• design, develop and maintain complex data ingestion, transformation and integration pipelines using Microsoft Fabric, OneLake and organisational data sources
• develop reusable engineering components, trusted datasets and data products to support analytics, reporting, Azure AI and machine-learning workloads
• implement validation, reconciliation and quality controls, ensuring that data solutions meet agreed lineage, metadata, governance and security standards
• implement CI/CD, automated testing and DataOps practices, optimising pipelines for performance, scalability, resilience and cost
• monitor and troubleshoot data pipelines, lead root-cause analysis and work with development security operations (DevSecOps), artificial intelligence operations (AIOps) and Application Support to improve operational reliability
• work with data scientists, analysts, delivery teams and suppliers to translate requirements into robust solutions, supported by appropriate documentation and recovery procedures
• provide technical leadership and management support to other engineers through mentoring, peer review and technical assurance, contributing to engineering standards and continuous improvement.

Responsibilities

• design, develop and maintain complex data ingestion, transformation and integration pipelines using Microsoft Fabric, OneLake and organisational data sources
• develop reusable engineering components, trusted datasets and data products to support analytics, reporting, Azure AI and machine-learning workloads
• implement validation, reconciliation and quality controls, ensuring that data solutions meet agreed lineage, metadata, governance and security standards
• implement CI/CD, automated testing and DataOps practices, optimising pipelines for performance, scalability, resilience and cost
• monitor and troubleshoot data pipelines, lead root-cause analysis and work with development security operations (DevSecOps), artificial intelligence operations (AIOps) and Application Support to improve operational reliability
• work with data scientists, analysts, delivery teams and suppliers to translate requirements into robust solutions, supported by appropriate documentation and recovery procedures
• provide technical leadership and management support to other engineers through mentoring, peer review and technical assurance, contributing to engineering standards and continuous improvement.

Job description

Government Recruitment Service in Newcastle-upon-Tyne is seeking a Senior Data Engineer to lead the development and governance of our enterprise data architecture, aligning technology with organisational strategy, digital transformation and secure-by-design principles. Your work will support long-term capability, resilience and value for money, creating a modern, sustainable service.

You will work across Microsoft Fabric, OneLake and Azure services to develop secure, governed data solutions,