DV-Cleared Data Engineer: Real-Time Data Pipelines

Searchability NS&D; Gloucester; Hybrid; GBP 65,000 - 90,000; Full time

Benefits offered by this job

6% bonus

25 days holiday

Job summary

Searchability NS&D in Gloucester is seeking a Data Engineer for a permanent role with active Enhanced DV clearance. Hybrid working when possible, on-site in Gloucester when required.

You will design and manage data pipelines, ETL processes, and data integration for National Security clients using Apache tools including NiFi, Kafka, and SQL/NoSQL databases like MongoDB. Proficiency in Groovy, Python or Java for ETL, data modeling, and data governance is essential.

Qualifications

• Active eDV clearance (West).
• Full-time on-site work in Gloucester when required.
• Experience with data pipelines, ETL, and data integration.

Responsibilities

• Design and develop data pipelines including ingestion, orchestration and ETL.
• Ensure data quality, consistency and security across processes.
• Create/maintain database schemas and data models.
• Integrate data from diverse sources and enrich datasets.
• Maintain and enhance data ingestion and storage components.
• Troubleshoot integrated data systems and monitor performance.
• Collaborate with scrum to decompose requirements into epics and stories.
• Write clean, secure, reusable code with test-driven development.

Skills

Data pipelines

ETL processing

Distributed computing

SQL

NoSQL

Apache

NiFi

Kafka

Security clearance

Tools

Groovy

Python

Java

MongoDB

Job description

Searchability NS&D in Gloucester is seeking a Data Engineer for a permanent role with active Enhanced DV clearance. Hybrid working when possible, on-site in Gloucester when required.

You will design and manage data pipelines, ETL processes, and data integration for National Security clients using Apache tools including NiFi, Kafka, and SQL/NoSQL databases like MongoDB. Proficiency in Groovy, Python or Java for ETL, data modeling, and data governance is essential.