Data Engineer

NSD; Gloucester; Hybrid; GBP 63,000 - 77,000; Full time

Benefits offered by this job

6% bonus

25 days holiday

Clearance bonus

Job summary

NSD in Gloucester is seeking a data engineering specialist to help design and operate mission-critical data pipelines for national security clients. You will develop ingestion, orchestration, and ETL processes while ensuring data quality, security, and scalability across diverse systems.

The role requires hands-on work with Kafka, NiFi, SQL and NoSQL databases (e.g., MongoDB), and programming with Groovy, Python, and Java.

Qualifications

• Must have active Enhanced DV clearance (West).
• Willingness to work full time on site in Gloucester when needed.
• Experience with Apache Kafka and Apache NiFi.
• Experience with SQL and NoSQL databases (e.g., MongoDB).
• Experience with ETL processing languages (Groovy, Python, or Java).
• Experience in data pipelines, ETL processing, and data integration.

Responsibilities

• Develop mission-critical data solutions and manage pipelines turning diverse data sources into insights for National Security customers.
• Collaborate with clients to solve complex challenges using distributed computing for large-scale, real-time data.
• Design and develop data pipelines including ingestion, orchestration, and ETL processing.
• Ensure data consistency, quality, and security across all processes.
• Create and maintain database schemas and data models.
• Integrate and enrich data from diverse sources while maintaining integrity.
• Maintain and enhance components such as Data Ingest and Data Stores.
• Troubleshoot and diagnose issues within integrated data systems.
• Collaborate with scrum team to break down requirements into epics and stories.
• Write clean, secure, and reusable code using test-driven development.

Tools

Kafka

NiFi

SQL

NoSQL

MongoDB

Groovy

Python

Java

ETL

Data pipelines

Job description

Salary: £70,000 - 70,000 per year

Requirements:

• We require active Enhanced DV Clearance (West).
• We require willingness to work full time on site in Gloucester when needed.
• We require experience with Apache Kafka.
• We require experience with Apache NiFi.
• We require experience with SQL and NoSQL databases, such as MongoDB.
• We require experience with ETL processing languages such as Groovy, Python, or Java.
• We require experience in data pipelines, ETL processing, and data integration.

Responsibilities:

• We develop mission-critical data solutions and manage pipelines that turn diverse data sources into valuable insights for our National Security customers.
• We collaborate with clients to solve complex challenges using distributed computing techniques for large-scale, real-time, and unstructured data.
• We design and develop data pipelines, including ingestion, orchestration, and ETL processing.
• We ensure data consistency, quality, and security across all processes.
• We create and maintain database schemas and data models.
• We integrate and enrich data from diverse sources while maintaining data integrity.
• We maintain and enhance architectural components such as Data Ingest and Data Stores.
• We troubleshoot and diagnose issues within integrated and enriched data systems.
• We collaborate with the scrum team to break down user requirements into epics and stories.
• We write clean, secure, and reusable code using a test-driven development approach.
• We monitor system performance and implement updates to maintain optimal operation.

Technologies:

• AI
• Cloud
• DevOps
• ETL
• Groovy
• Java
• Kafka
• MongoDB
• NoSQL
• Python
• SQL
• Security

More:

We are a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. We work with cutting-edge technologies across AI and Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. We have long-term contracts secured across the latest customer framework and are set for significant growth. The role is based in Gloucester with hybrid working where possible, and we offer a competitive salary depending on experience.

Benefits:

• a 6% bonus
• 25 days holiday
• a clearance bonus

last updated 40 week of 2026