Data Engineer: ETL, PySpark & Dashboards in Cloud

Allscreens Nationwide Ltd; Lancashire; Hybrid; GBP 33,000 - 45,000; Full time

Benefits offered by this job

Hybrid work

Pension

Holiday leave

Volunteer time off

Discounts

Loans

Development opportunities

Job summary

DWP Digital is seeking a Data Engineer to join the Debt Solutions team, shaping data strategy and analytics for the department. You will design, build and maintain data products supporting analytics, business intelligence and operational decision-making across Debt Solutions.

Collaborate in an agile, multidisciplinary team to transform critical data into trusted insights and deliver impact at national scale.

Qualifications

• Experience developing and managing PySpark workflows in AWS.
• Knowledge of AWS Lambda and event-driven solutions for automated data processing.
• Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools.
• Understanding of Agile ways of working and CI/CD delivery practices.
• Ability to optimise data processing, storage and queries to improve performance and data quality.

Responsibilities

• Design, build and maintain data products to support analytics, BI and decision-making.
• Develop and operate ETL pipelines in cloud environments and integrate data from multiple sources.
• Create reusable production-ready data solutions using SQL and modern data engineering practices.
• Develop user-facing dashboards and reports for accessible insights for customers and stakeholders.

Skills

PySpark

AWS Lambda

EC2

CI/CD

Data optimisation

Job description

DWP Digital is seeking a Data Engineer to join the Debt Solutions team, shaping data strategy and analytics for the department. You will design, build and maintain data products supporting analytics, business intelligence and operational decision-making across Debt Solutions.

Collaborate in an agile, multidisciplinary team to transform critical data into trusted insights and deliver impact at national scale.