Data Engineer I: Cloud Pipelines & Insight Dashboards

DWP Digital; Manchester; Hybrid; GBP 33,000 - 45,000; Full time

Benefits offered by this job

Hybrid working 40/60 schedule

Public sector pension contributions 28

Generous leave 24–26 days + stats

Job summary

DWP Digital in Manchester is seeking a Data Engineer to join the Debt Solutions team. You will design and operate SQL-based data transformations, ETL pipelines and dashboards to support analytics and decision-making across critical debt operations.

Working in an agile, hybrid environment, you will partner with colleagues to deliver scalable, cloud-enabled data products that drive insight and improve data quality while supporting governance and security standards.

Qualifications

• Experience developing and managing PySpark workflows within AWS environments.
• Knowledge of AWS Lambda and event-driven solutions to support automated data processing.
• Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools.
• Understanding of Agile ways of working and experience contributing to CI/CD delivery practices.
• Ability to optimise data processing, storage, and queries to improve performance and data quality.

Responsibilities

• As a Data Engineer in DWP Digital, you'll design, build and maintain data products that support analytics, business intelligence and operational decision-making across Debt Solutions.
• Working as part of a multidisciplinary agile team, you'll help transform critical business data into trusted insights, supporting systems that recover around £3 billion of debt annually while protecting vulnerable citizens.
• You will develop and operate ETL pipelines in cloud-based environments, integrating data from a variety of source systems and transforming it into meaningful, trusted information.
• Using SQL and modern data engineering practices, you'll create reusable, production-ready solutions that enable colleagues and stakeholders to gain valuable insights from data.
• Working with senior colleagues, you'll help develop user-facing dashboards and reports that provide accessible, accurate information to customers and stakeholders.

Skills

PySpark workflows

AWS Lambda

Amazon EC2

CI/CD

SQL data transformation

Agile methodologies

Tools

AWS

Job description

DWP Digital in Manchester is seeking a Data Engineer to join the Debt Solutions team. You will design and operate SQL-based data transformations, ETL pipelines and dashboards to support analytics and decision-making across critical debt operations.

Working in an agile, hybrid environment, you will partner with colleagues to deliver scalable, cloud-enabled data products that drive insight and improve data quality while supporting governance and security standards.