Senior Data Engineer — Data Platforms & AI

Government Recruitment Service; City of Edinburgh; On-site; GBP 44,000 - 53,000; Full time

Benefits offered by this job

Disability Confident employer scheme

Job summary

Government Recruitment Service is hiring a Senior Data Engineer in Edinburgh to lead the development and governance of our enterprise data architecture. You will align technology with strategy, support digital transformation, and ensure secure-by-design data solutions across Dynamics 365, Dataverse, Azure services, and Microsoft Fabric.

You will mentor engineers, collaborate with data scientists and analysts, and drive data quality, CI/CD, and DataOps practices to improve resilience and value

Responsibilities

• design, develop and maintain complex data ingestion, transformation and integration pipelines using Microsoft Fabric, OneLake and organisational data sources
• develop reusable engineering components, trusted datasets and data products to support analytics, reporting, Azure AI and machine-learning workloads
• implement validation, reconciliation and quality controls, ensuring that data solutions meet agreed lineage, metadata, governance and security standards
• implement CI/CD, automated testing and DataOps practices, optimising pipelines for performance, scalability, resilience and cost
• monitor and troubleshoot data pipelines, lead root-cause analysis and work with development security operations (DevSecOps), artificial intelligence operations (AIOps) and Application Support to improve operational reliability
• work with data scientists, analysts, delivery teams and suppliers to translate requirements into robust solutions, supported by appropriate documentation and recovery procedures
• provide technical leadership and management support to other engineers through mentoring, peer review and technical assurance, contributing to engineering standards and continuous improvement.

Job description

Government Recruitment Service is hiring a Senior Data Engineer in Edinburgh to lead the development and governance of our enterprise data architecture. You will align technology with strategy, support digital transformation, and ensure secure-by-design data solutions across Dynamics 365, Dataverse, Azure services, and Microsoft Fabric.

You will mentor engineers, collaborate with data scientists and analysts, and drive data quality, CI/CD, and DataOps practices to improve resilience and value