Data Engineer I: Cloud Pipelines & Dashboards (Hybrid)

Career Choices Dewis Gyrfa Ltd; Manchester; Hybrid; GBP 33,000 - 45,000; Full time

Benefits offered by this job

Hybrid working model

Civil service pension

Generous leave and volunteering

Professional development

Job summary

DWP Digital Debt Solutions is hiring a Data Engineer to design, build and maintain data products that support analytics, BI and operational decision-making.

You will develop ETL pipelines in cloud environments, use SQL and PySpark, and create user-facing dashboards and reports for stakeholders. This hybrid role offers a salary of £38,772 with a civil service pension and generous leave.

Qualifications

• Experience developing and managing PySpark workflows within AWS environments.
• Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools.
• Understanding of Agile ways of working and experience contributing to CI/CD delivery practices.
• Ability to optimise data processing, storage, and queries to improve performance and data quality.

Responsibilities

• Design, build and maintain data products that support analytics, business intelligence and operational decision-making across Debt Solutions.
• Develop and operate ETL pipelines in cloud-based environments, integrating data from multiple source systems.
• Create reusable, production-ready SQL and PySpark solutions for stakeholders to gain insights.
• Develop user-facing dashboards and reports that provide accessible information to customers and partners.

Skills

PySpark

AWS Lambda

SQL

CI/CD

ETL

Tools

AWS

EC2

Job description

DWP Digital Debt Solutions is hiring a Data Engineer to design, build and maintain data products that support analytics, BI and operational decision-making.

You will develop ETL pipelines in cloud environments, use SQL and PySpark, and create user-facing dashboards and reports for stakeholders. This hybrid role offers a salary of £38,772 with a civil service pension and generous leave.