Data Engineer – Hybrid (AWS/PySpark) ETL & Dashboards

Career Choices Dewis Gyrfa Ltd; Newcastle upon Tyne; Hybrid; GBP 35,000 - 43,000; Full time

Job summary

DWP Digital is seeking a Data Engineer to join the Debt Solutions team. You will design, build and maintain data products for analytics and decision-making, transforming critical data into trusted insights. You will develop and operate ETL pipelines in cloud environments, ensuring data quality and accessibility for stakeholders.

The role emphasises hybrid working, with a mix of home and hub-based collaboration, and offers a generous package within the Civil Service framework.

Qualifications

• Experience developing and managing PySpark workflows within AWS environments.
• Knowledge of AWS Lambda and event-driven solutions to support automated data processing.
• Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools.
• Understanding of Agile ways of working and experience contributing to CI/CD delivery practices.
• Ability to optimise data processing, storage, and queries to improve performance and data quality.

Responsibilities

• Design, build and maintain data products that support analytics, business intelligence and operational decision-making across Debt Solutions.
• Develop and operate ETL pipelines in cloud-based environments, integrating data from multiple sources.
• Create reusable, production-ready data solutions that enable stakeholders to gain insights from data.

Skills

PySpark

SQL

Agile methodologies

CI/CD practices

Tools

AWS Lambda

Amazon EC2

Automation tools

Job description

DWP Digital is seeking a Data Engineer to join the Debt Solutions team. You will design, build and maintain data products for analytics and decision-making, transforming critical data into trusted insights. You will develop and operate ETL pipelines in cloud environments, ensuring data quality and accessibility for stakeholders.

The role emphasises hybrid working, with a mix of home and hub-based collaboration, and offers a generous package within the Civil Service framework.