Senior Data Engineer - DataOps & AI Pipelines (Flexible)

Government Recruitment Service; Manchester; On-site; GBP 44,000 - 53,000; Full time

Benefits offered by this job

Disability Confident employer

Flexible working

Space to grow and take ownership

Job summary

Government Recruitment Service in Manchester is seeking a Senior Data Engineer to lead the development and governance of our enterprise data architecture. You will align technology with organisational strategy and drive digital transformation, security-by-design, and value for money.

You will collaborate with data scientists and analysts, manage pipelines across Microsoft Fabric, OneLake, Dynamics 365 and Azure services, and provide technical leadership to the engineering team while supporting

Qualifications

• Proven experience designing and implementing complex data pipelines.
• Strong knowledge of Microsoft Fabric, OneLake, Dataverse and Azure services.
• Experience with CI/CD, DataOps and data governance practices.

Responsibilities

• design, develop and maintain complex data ingestion, transformation and integration pipelines using Microsoft Fabric, OneLake and organisational data sources
• develop reusable engineering components, trusted datasets and data products to support analytics, reporting, Azure AI and machine-learning workloads
• implement validation, reconciliation and quality controls, ensuring that data solutions meet governance and security standards
• implement CI/CD, automated testing and DataOps practices, optimising pipelines for performance and cost
• monitor and troubleshoot data pipelines, lead root-cause analysis with DevSecOps and AIOps to improve reliability
• work with data scientists, analysts and suppliers to translate requirements into robust solutions with proper documentation and recovery procedures
• provide technical leadership and mentoring to other engineers and contribute to engineering standards

Skills

Data engineering

Leadership

CI/CD

Data governance

Azure AI

Tools

Microsoft Fabric

OneLake

Dynamics 365

Dataverse

Azure services

Job description

Government Recruitment Service in Manchester is seeking a Senior Data Engineer to lead the development and governance of our enterprise data architecture. You will align technology with organisational strategy and drive digital transformation, security-by-design, and value for money.

You will collaborate with data scientists and analysts, manage pipelines across Microsoft Fabric, OneLake, Dynamics 365 and Azure services, and provide technical leadership to the engineering team while supporting