Data Engineer Level I — Hybrid, Cloud ETL & Dashboards

DWP Digital; Birmingham; Hybrid; GBP 33,000 - 45,000; Full time

Benefits offered by this job

Hybrid Working

Competitive pay

Civil service pension

Generous holidays

Job summary

DWP Digital is seeking a Data Engineer for the Debt Solutions team to shape data infrastructure. You'll design and build data products to support analytics, BI and operational decision-making, with a focus on reliability and scale.

Working in a multidisciplinary agile team, you will develop and operate ETL pipelines in AWS, use PySpark, and create dashboards and reports that help colleagues and stakeholders derive insights.

Qualifications

• Experience developing and managing PySpark workflows within AWS environments.
• Knowledge of AWS Lambda and event-driven solutions to support automated data processing.
• Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools.
• Understanding of Agile ways of working and experience contributing to CI/CD delivery practices.
• Ability to optimise data processing, storage, and queries to improve performance and data quality.

Responsibilities

• Design, build and maintain data products that support analytics, business intelligence and operational decision-making.
• Transform critical business data into trusted insights, supporting systems that recover around £3 billion of debt annually while protecting vulnerable citizens.
• Develop and operate ETL pipelines in cloud-based environments, integrating data from a variety of source systems and transforming it into meaningful, trusted information.
• Create reusable, production-ready SQL-based solutions that enable colleagues and stakeholders to gain valuable insights from data, including user-facing dashboards and reports.

Skills

PySpark

SQL

AWS

CI/CD

Agile

Data quality

Tools

AWS Lambda

Amazon EC2

Job description

DWP Digital is seeking a Data Engineer for the Debt Solutions team to shape data infrastructure. You'll design and build data products to support analytics, BI and operational decision-making, with a focus on reliability and scale.

Working in a multidisciplinary agile team, you will develop and operate ETL pipelines in AWS, use PySpark, and create dashboards and reports that help colleagues and stakeholders derive insights.