Data Engineer: Cloud ETL, Dashboards & Analytics (Hybrid)

DWP Digital; Newcastle upon Tyne; Hybrid; GBP 38,000 - 42,000; Full time

Benefits offered by this job

Hybrid working

Competitive pay

Civil service pension

Generous holidays

Professional development

Job summary

DWP Digital in the United Kingdom is seeking a Data Engineer to join the Debt Solutions team to design, build and maintain data products that support analytics and decision-making across the department.

You will develop and operate ETL pipelines in cloud environments, transform data from multiple sources, and create dashboards and reports that provide trusted information to colleagues and stakeholders, enabling better decisions and improved debt recovery outcomes.

Qualifications

• Experience developing and managing PySpark workflows within AWS environments.
• Knowledge of AWS Lambda and event-driven solutions to support automated data processing.
• Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools.
• Understanding of Agile ways of working and experience contributing to CI/CD delivery practices.
• Ability to optimise data processing, storage, and queries to improve performance and data quality.

Responsibilities

• Design, build and maintain data products that support analytics, business intelligence and operational decision-making across Debt Solutions.
• Help transform critical business data into trusted insights, supporting systems that recover billions in debt annually while protecting citizens.
• Develop and operate ETL pipelines in cloud-based environments, integrating data from various sources and transforming it into meaningful information.
• Create reusable, production-ready data solutions using SQL to enable stakeholders to gain valuable insights and dashboards.

Skills

PySpark workflows

AWS Lambda

EC2 cloud infra

Agile CI/CD

Data processing optimisation

Tools

EC2

Job description

DWP Digital in the United Kingdom is seeking a Data Engineer to join the Debt Solutions team to design, build and maintain data products that support analytics and decision-making across the department.

You will develop and operate ETL pipelines in cloud environments, transform data from multiple sources, and create dashboards and reports that provide trusted information to colleagues and stakeholders, enabling better decisions and improved debt recovery outcomes.