Data Engineer: Cloud ETL & Dashboards (Hybrid)

Women in Data®; Manchester; Hybrid; GBP 35,000 - 43,000; Full time

Benefits offered by this job

Hybrid working

Civil service pension 28.97%

Generous leave 24–31 days + flex time

Job summary

DWP Digital is seeking a Data Engineer to join the Debt Solutions team. You will design, build and maintain data products that support analytics and operational decision-making, with a focus on ETL pipelines in cloud environments and user-facing dashboards.

You’ll work in a multidisciplinary agile team, helping to transform critical business data into trusted insights while contributing to scalable, cloud-powered data services across the department.

Qualifications

• Experience developing and managing PySpark workflows within AWS environments.
• Knowledge of AWS Lambda and event-driven solutions to support automated data processing.
• Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools.
• Understanding of Agile ways of working and experience contributing to CI/CD delivery practices.
• Ability to optimise data processing, storage, and queries to improve performance and data quality.

Responsibilities

• Design, build and maintain data products that support analytics and BI across Debt Solutions.
• Develop and operate ETL pipelines in cloud-based environments, integrating data from multiple source systems.
• Create reusable, production-ready SQL-based data solutions and dashboards for insights.
• Collaborate in a multidisciplinary agile team to deliver national-scale data solutions.

Skills

PySpark workflows

AWS Lambda

AWS EC2

CI/CD

SQL optimization

Job description

DWP Digital is seeking a Data Engineer to join the Debt Solutions team. You will design, build and maintain data products that support analytics and operational decision-making, with a focus on ETL pipelines in cloud environments and user-facing dashboards.

You’ll work in a multidisciplinary agile team, helping to transform critical business data into trusted insights while contributing to scalable, cloud-powered data services across the department.