Azure Data Platform Engineer

National Audit Office; Greater London; Hybrid; GBP 61,000 - 70,000; Full time

Benefits offered by this job

Civil service pension with employer 28

Hybrid working

Job summary

The National Audit Office is seeking a Data Platform Engineer to design, build and maintain cloud-based data pipelines across the organisation. You will ingest diverse data sources, ensure quality and security, and collaborate with analytics engineers and data scientists to deliver reliable data products.

You will work with Azure Databricks, Data Factory and related tools, contributing to scalable data infrastructure and governance.

Qualifications

• Deep hands-on experience designing cloud-based data pipelines in Azure.
• Expertise in ETL/ELT pipelines, data modelling and semantic layers.
• Strong Python, SQL skills and familiarity with CI/CD practices.

Responsibilities

• Build, scale and maintain data pipelines ingesting data from multiple sources.
• Design robust ETL workflows for centralised platforms and analytics use.
• Collaborate with analytics engineers, data scientists, and stakeholders.
• Ensure data quality, security and performance across systems.
• Document architecture and data governance procedures.
• Maintain data infrastructure and improve reliability and scalability.

Skills

Cloud data engineering

Python

SQL

ETL/ELT pipelines

Azure Databricks

Azure Data Factory

Data modelling

CI/CD

DevOps collaboration

Tools

Azure Databricks

Microsoft Fabric

Azure Data Factory

Power BI

Purview

Job description

The National Audit Office is seeking a Data Platform Engineer to design, build and maintain cloud-based data pipelines across the organisation. You will ingest diverse data sources, ensure quality and security, and collaborate with analytics engineers and data scientists to deliver reliable data products.

You will work with Azure Databricks, Data Factory and related tools, contributing to scalable data infrastructure and governance.