Security-Cleared Data Engineer (eDV) - Manchester

Searchability NS&D; Manchester; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

Searchability NS&D in Manchester is seeking a Data Engineer with active eDV clearance to join a National Security program on a hybrid basis. You will design and operate data pipelines, handle ingestion, ETL processes, and ensure data quality and security across diverse sources.

You will work with technologies like NiFi, MongoDB, Kafka, Python/Java/Groovy in a real-time, large-scale data environment, collaborating with the scrum team to translate requirements into epics and implement secure,

Qualifications

• Experience with data pipelines, ETL, and data integration in large-scale environments.
• Experience with distributed computing and real-time data processing.

Responsibilities

• Design and develop data pipelines including ingestion, orchestration, and ETL.
• Ensure data quality, security, and consistency across processes.
• Create and maintain database schemas and data models.
• Integrate and enrich data from diverse sources, maintaining data integrity.
• Collaborate with the scrum team to decompose user requirements into epics and stories.
• Write clean, secure, and reusable code following a test-driven development approach.
• Monitor system performance and implement updates to maintain optimal operation.

Skills

Data pipelines

ETL processing

Data integration

Apache

SQL/NoSQL

NiFi

MongoDB

Kafka

Distributed computing

Real-time data

Tools

NiFi

MongoDB

Kafka

Python

Java

Groovy

Job description

Searchability NS&D in Manchester is seeking a Data Engineer with active eDV clearance to join a National Security program on a hybrid basis. You will design and operate data pipelines, handle ingestion, ETL processes, and ensure data quality and security across diverse sources.

You will work with technologies like NiFi, MongoDB, Kafka, Python/Java/Groovy in a real-time, large-scale data environment, collaborating with the scrum team to translate requirements into epics and implement secure,