Data Engineer I: Cloud ETL & BI Dashboards | Hybrid

DWP Digital; Lancashire; Hybrid; GBP 33,000 - 45,000; Full time

Benefits offered by this job

Civil service pension

Hybrid working (40% home, 60% hub)

Generous holidays 24–31 days

Job summary

DWP Digital is seeking a Data Engineer to join the Debt Solutions team, shaping the future of data across the organisation. You will design, build and maintain data products that support analytics, business intelligence and operational decision-making.

Working in a multidisciplinary agile team, you will develop and operate ETL pipelines in cloud environments, transforming data from multiple sources into trusted information, and create dashboards and reports for stakeholders.

Qualifications

• Experience developing and managing PySpark workflows in AWS environments.
• Knowledge of AWS Lambda and event-driven solutions for automated processing.
• Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools.
• Understanding Agile methodologies and contributing to CI/CD delivery practices.
• Ability to optimise data processing, storage and queries for performance and quality.

Responsibilities

• Design, build and maintain data products for analytics and BI across Debt Solutions.
• Transform critical business data into trusted insights to support operations.
• Develop and operate ETL pipelines in cloud environments.
• Create dashboards and reports enabling stakeholders to access accurate information.
• Collaborate in a multidisciplinary agile team to modernise MI and data services.

Skills

PySpark

AWS Lambda

CI/CD

Agile

Data quality

Tools

AWS EC2

ETL tooling

Job description

DWP Digital is seeking a Data Engineer to join the Debt Solutions team, shaping the future of data across the organisation. You will design, build and maintain data products that support analytics, business intelligence and operational decision-making.

Working in a multidisciplinary agile team, you will develop and operate ETL pipelines in cloud environments, transforming data from multiple sources into trusted information, and create dashboards and reports for stakeholders.