Data Engineer | AWS PySpark & Analytics (Hybrid)

DWP Digital

Newcastle upon Tyne

Hybrid

GBP 31,000 - 52,000

Full time

8 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Time off volunteering and charitable給

I Can Be Me in DWP programme

Discounts and savings on shopping

Interest-free loans for bike or season

Professional development and mentoring

Job summary

DWP Digital is seeking a Data Engineer to join the Management Information team. You’ll develop scalable data solutions using AWS tech (PySpark on AWS, EMR, Lambda, EC2) to power reporting and analytics. The role blends hands-on data engineering with Agile delivery and CI/CD practices.

You’ll work in a hybrid cloud setting, focusing on data quality, performance and security while collaborating with analysts and data scientists to translate reporting needs into robust data products.

Qualifications

Experience developing and managing PySpark workflows within AWS environments.
Knowledge of AWS Lambda and event-driven solutions for automated data processing.
Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools.
Understanding of Agile ways of working and contributing to CI/CD practices.
Ability to optimise data processing, storage, and queries for performance and data quality.

Responsibilities

Deliver modern data engineering solutions to support reporting, BI and decision-making.
Design, build, maintain and optimise scalable data products in a hybrid AWS environment.
Develop and orchestrate PySpark-based ETL pipelines with EMR, Lambda and EC2.
Collaborate with stakeholders to translate requirements into robust technical solutions.