Hybrid Data Engineer — AWS, PySpark, BI Dashboards

Career Choices Dewis Gyrfa Ltd; Birmingham; Hybrid; GBP 35,000 - 43,000; Full time

Benefits offered by this job

Hybrid working model (40% home, 60% in

Civil Service pension 28.97%

Job summary

DWP Digital, part of the UK government, is hiring a Data Engineer to join the Debt Solutions team. You will design, build and operate ETL pipelines in cloud environments, use SQL for transformations, and develop dashboards and reports to support analytics and decision-making.

This hybrid role offers £38,772 pay, a generous Civil Service pension (28.97%), holidays to 26 days (and up to 31 with service), and other benefits.

Qualifications

• Experience developing and managing PySpark workflows within AWS environments.
• Knowledge of AWS Lambda and event-driven solutions to support automated data processing.
• Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools.
• Understanding of Agile ways of working and experience contributing to CI/CD delivery practices.
• Ability to optimise data processing, storage, and queries to improve performance and data quality.

Responsibilities

• As a Data Engineer in DWP Digital, design, build and maintain data products that support analytics, business intelligence and operational decision-making across Debt Solutions.
• Develop and operate ETL pipelines in cloud-based environments, integrating data from multiple sources and transforming it into trusted information.
• Create reusable, production-ready SQL-based data processing solutions and dashboards/reports for stakeholders.
• Collaborate with a multidisciplinary agile team to deliver data services at national scale.

Skills

PySpark workflows

SQL-based data transformation

Agile / CI-CD delivery practices

Data performance optimization

Dashboard and reports development

Tools

AWS Lambda

Amazon EC2

Job description

DWP Digital, part of the UK government, is hiring a Data Engineer to join the Debt Solutions team. You will design, build and operate ETL pipelines in cloud environments, use SQL for transformations, and develop dashboards and reports to support analytics and decision-making.

This hybrid role offers £38,772 pay, a generous Civil Service pension (28.97%), holidays to 26 days (and up to 31 with service), and other benefits.