Data Engineer - SC Cleared - AWS

SR2 REC LTD; Greater London; On-site; GBP 68,000 - 90,000; Full time

Job summary

SR2 REC LTD in London is seeking an experienced Data Engineer to design, build and support secure, scalable data pipelines in a government data and analytics programme. You will work across cloud infrastructure, streaming technologies and production data environments, with active SC clearance required.

The role focuses on Python development, AWS services and Kafka-based streaming, plus infrastructure as code and robust data workflows.

Qualifications

• Strong Python engineering experience.
• Strong AWS experience.
• Experience with Apache Kafka / streaming data.
• Experience with Terraform.
• Strong SQL skills.
• ETL/ELT and data pipeline development.
• CI/CD and automated deployment.

Responsibilities

• Design, build and maintain data pipelines and data-processing services.
• Develop production-quality solutions using Python and SQL.
• Build and support Kafka-based streaming and event-driven architectures.
• Work with AWS services and cloud-native data platforms.
• Manage infrastructure through Terraform / Infrastructure as Code.
• Support data profiling, mapping and transformation.
• Re-engineer pipelines as upstream systems or requirements change.
• Contribute to monitoring, incident investigation and production support.
• Collaborate with engineering and delivery teams to improve data services.

Skills

Python

AWS

Kafka/Streaming

SQL

ETL/ELT

CI/CD

Production data services

Tools

Terraform

Job description

Data Engineer - AWS / Python / Kafka - SC Cleared

We are looking for experienced Data Engineers to support a large-scale central government data and analytics programme.

You will design, build and support secure, scalable data pipelines and services, working across cloud infrastructure, streaming technologies and production data environments.

Due to the nature of the roles, active SC is required.

Key responsibilities

• Design, build and maintain data pipelines and data-processing services.
• Develop production-quality solutions using Python and SQL.
• Build and support Kafka-based streaming and event-driven architectures.
• Work with AWS services and cloud-native data platforms.
• Manage infrastructure through Terraform / Infrastructure as Code.
• Support data profiling, mapping and transformation.
• Re-engineer existing pipelines as upstream systems or requirements change.
• Contribute to monitoring, incident investigation and production support.
• Work with engineering, architecture and delivery teams to improve data services.

Essential experience

• Strong Python engineering experience.
• Strong AWS experience.
• Apache Kafka / streaming data.
• Terraform.
• Strong SQL.
• ETL / ELT and data pipeline development.
• CI/CD and automated deployment.
• Experience supporting production data services.