Data Engineer (G7)

Government Recruitment Service; Coventry; Remote; GBP 58,000 - 76,000; Full time

Job summary

Government Recruitment Service is seeking a Senior Data Engineer (G7) to lead Azure data engineering initiatives and design scalable ETL/ELT pipelines using PySpark and Python. You will guide stakeholder collaboration, ensure data availability, and oversee data governance across multiple systems.

Location options include London, Coventry, Darlington, Sheffield and Leeds, with a UK-wide posting and security clearance as a requirement for the role.

Qualifications

• Security Check clearance is required.
• UK residence: 3 of last 5 years, 2 of which immediately precede application.
• Senior Data Engineer with Azure data engineering and ETL/ELT design experience.

Responsibilities

• Lead the team in designing, developing and maintaining scalable ETL/ELT pipelines using PySpark and Python.
• Gather data requirements from stakeholders and shape datasets for analysts.
• Manage data supply to multiple systems and secure data availability with efficient scripts.
• Oversee large-scale data transformations and migrations, setting direction for change.
• Develop cloud data engineering pipelines and implement logging and monitoring.

Skills

Leadership

Stakeholder management

Agile practices

Tools

PySpark

Python

Google Cloud DataCatalog

AWS Glue DataCatalog

Azure DataCatalog

Informatica Enterprise DataCatalog

Alation

Apache Atlas

Job description

Data Engineer (G7)

Company: Government Recruitment Service
Salary: £57,946 to £75,664 a year
Hours: Full-time
Location: CV1 2WT
Job type: Permanent
Posting date: 16 Oct 2026
Closing date: 1 Nov 2026

Summary

Please notethis role requires you to passSecurity Checkclearance. For further information, please see 'Selection process details'.

You must have resided continuously in the UK for at least 3 of the last 5 years, 2 of which must have been the immediately preceding years from the point of applying for this job.

Are you a Senior Data Engineer with expert-level experience in Azure data engineering, ETL/ELT pipeline design and technical team leadership?

Join DWP as part of our Data Engineering community, where you will lead the design and delivery of secure, scalable data solutions that power services used by millions of people across the UK. This role plays a key part in ensuring our data estate is reliable, well-governed and continuously improving, enabling analysts, data scientists and operational teams to access trusted data at scale.

Roles and Responsibilities:

• Lead the team in designing, developing andmaintainingscalable ETL/ELT pipelinesusingastrong knowledge of PySpark and Python to ensure best practice and standards are met in optimizing,validatingand standardising all team data workflows as well as batch processes.
• Lead collection of complex data requirements from a wide range of stakeholders, interpret the data and shape data sets to for Data Analysts to fulfil requirements in their creation of analysis and insight dashboards.
• Lead the build and management as well as the supply of data to multiple systems and applications including database management. This to secure data availability and the construction of efficient scripts to extract data for cross business usage.
• Leading immediate team though large-scale data and platform transformation and/or migration programmes, ensuring bestpracticeand building capability within the team as the transformation occurs. Set direction of change and proactivelyidentifykey issues.
• Apply a deep understanding and experience of cloud data engineering toolsets in developing complex pipelines, lead development of products and automation processes. Lead development of logging,monitoringand assuring tool performance information.
• Oversee, support and manage team in developing and using a range of operational tracking and cataloguing tools to track data and metadata through its journey such as: Google Cloud DataCatalog, AWS Glue DataCatalog, Azure DataCatalog, Informatica Enterprise DataCatalog, Alation, Apache Atlas etc. Ensuring compliance with business standards.
• Lead the use of Agile practices in the team toleveragedata engineering tools like version control, automation, monitoring to streamline data pipelines, automate testing, deployment and track changes.

Skills England is an executive agency of the Department for Work and Pensions (DWP), working with employers, training providers, local partners and government to create better skills for better jobs. We play a leading role in identifying current and future skills needs across the economy, helping to ensure that people can access high-quality education, training and employment opportunities while supporting businesses to develop the skilled workforce they need. As part of the Digital and Data Services team you will play a key role in ensuring Skills England creates, maintains and uses data efficiently and effectively to drive decisions and produce high quality technical education products and labour market insights.

Locations for this team are: London, Coventry, Darlington, Sheffield, Leeds. Roles within other teams will be based in the locations advertised above. This can be discussed further, should you be successful.

Proud member of the Disability Confident employer scheme

About Disability Confident Disability Confident is a government scheme. It encourages employers to recruit and retain disabled people and those with long term health conditions.