DV-Cleared Data Engineer (Hybrid, Gloucester)

NSD; Gloucester; Hybrid; GBP 63,000 - 77,000; Full time

Benefits offered by this job

6% bonus

25 days holiday

Clearance bonus

Job summary

NSD in Gloucester is seeking a data engineering specialist to help design and operate mission-critical data pipelines for national security clients. You will develop ingestion, orchestration, and ETL processes while ensuring data quality, security, and scalability across diverse systems.

The role requires hands-on work with Kafka, NiFi, SQL and NoSQL databases (e.g., MongoDB), and programming with Groovy, Python, and Java.

Qualifications

• Must have active Enhanced DV clearance (West).
• Willingness to work full time on site in Gloucester when needed.
• Experience with Apache Kafka and Apache NiFi.
• Experience with SQL and NoSQL databases (e.g., MongoDB).
• Experience with ETL processing languages (Groovy, Python, or Java).
• Experience in data pipelines, ETL processing, and data integration.

Responsibilities

• Develop mission-critical data solutions and manage pipelines turning diverse data sources into insights for National Security customers.
• Collaborate with clients to solve complex challenges using distributed computing for large-scale, real-time data.
• Design and develop data pipelines including ingestion, orchestration, and ETL processing.
• Ensure data consistency, quality, and security across all processes.
• Create and maintain database schemas and data models.
• Integrate and enrich data from diverse sources while maintaining integrity.
• Maintain and enhance components such as Data Ingest and Data Stores.
• Troubleshoot and diagnose issues within integrated data systems.
• Collaborate with scrum team to break down requirements into epics and stories.
• Write clean, secure, and reusable code using test-driven development.

Tools

Kafka

NiFi

SQL

NoSQL

MongoDB

Groovy

Python

Java

ETL

Data pipelines

Job description

NSD in Gloucester is seeking a data engineering specialist to help design and operate mission-critical data pipelines for national security clients. You will develop ingestion, orchestration, and ETL processes while ensuring data quality, security, and scalability across diverse systems.

The role requires hands-on work with Kafka, NiFi, SQL and NoSQL databases (e.g., MongoDB), and programming with Groovy, Python, and Java.