Security-Cleared Data Software Engineer – Spark & Airflow

Public Sector Resourcing, managed by AMS; Manchester; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

Department for Work and Pensions (DWP) is seeking a Data Software Engineer for a 12-month Inside IR35 contract with hybrid working arrangements across Manchester, Birmingham, Blackpool, Leeds or Newcastle. You will deliver data software solutions and transform requirements into production-ready code.

You will ensure robust systems, design reusable libraries, and create automated tests, while supporting medium-long term product strategies and defining source control approaches.

Qualifications

• Strong background in Java, JavaScript, and Bash.
• Experience with Python, SQL, and PySpark.
• Good understanding of encryption techniques and practices.
• Understanding of data processing pipeline orchestration using Apache Airflow.
• Understanding of data processing using Apache Spark.
• Understanding of dimensional data models and slowly changing dimensions/historic data capture.

Responsibilities

• Deliver software products which make up services for our citizens to consume.
• Transform business requirements into production ready code.
• Ensure system robustness, resilience and stability.
• Design and develop reusable libraries and services and promote reuse across the department.
• Produce comprehensive suites of automated unit and integration tests to ensure code quality.
• Assure there is a fit for purpose, robust automated test suite.
• Assist in the development of medium-long term strategies for products.
• Define version control strategies for the source code of the product.

Skills

Java

JavaScript

Bash

Python

SQL

PySpark

Encryption

Airflow

Spark

Dimensional models

Slowly changing dims

Job description

Department for Work and Pensions (DWP) is seeking a Data Software Engineer for a 12-month Inside IR35 contract with hybrid working arrangements across Manchester, Birmingham, Blackpool, Leeds or Newcastle. You will deliver data software solutions and transform requirements into production-ready code.

You will ensure robust systems, design reusable libraries, and create automated tests, while supporting medium-long term product strategies and defining source control approaches.