Senior Data Engineer: Azure/PySpark | Hybrid + Pension

DWP Digital; Manchester; Hybrid; GBP 58,000 - 76,000; Full time

Benefits offered by this job

Hybrid working

Flexible hours

Civil service pension 28.97%

Generous holidays

Job summary

DWP Digital in the United Kingdom is recruiting a Senior Data Engineer to design and deliver cloud-based data solutions using Azure, PySpark and Spark SQL. You will lead technical teams, shape data pipelines, and ensure trusted data for decision-making across the organisation.

The role offers hybrid working, flexible hours, a generous civil service pension, and a competitive salary up to £75,664. You will work across multiple data platforms and collaborate with stakeholders.

Qualifications

• Proven experience designing and delivering complex ETL/ELT pipelines.
• Ability to communicate complex technical concepts to technical and non-technical audiences.
• Strong understanding of cloud data processing and scalable data solutions.

Responsibilities

• Lead the design and delivery of modern cloud-based data solutions.
• Drive automation and improve platform performance for data services.
• Mentor and develop capability within the data engineering team.
• Collaborate with stakeholders to transform business requirements into trusted data assets.

Skills

Azure

PySpark

Spark SQL

ETL/ELT pipelines

Data governance

Stakeholder communication

Cloud data engineering

Python

Team leadership

Job description

DWP Digital in the United Kingdom is recruiting a Senior Data Engineer to design and deliver cloud-based data solutions using Azure, PySpark and Spark SQL. You will lead technical teams, shape data pipelines, and ensure trusted data for decision-making across the organisation.

The role offers hybrid working, flexible hours, a generous civil service pension, and a competitive salary up to £75,664. You will work across multiple data platforms and collaborate with stakeholders.