DV Cleared Mission-Critical UK Gov Data Engineer

Searchability NS&D; Greater London; On-site; GBP 107,000 - 144,000; Full time

Job summary

Searchability NS&D in London is seeking an eDV-cleared Data Engineer to design and deliver mission-critical data services for national security clients. You will build robust data pipelines that process batch, streaming and real-time data to enable analytics at scale.

Responsibilities include ETL development, data modeling, data integration and security controls. The role is a 12-month, full-time on-site engagement in Central London with a daily rate of £680 inside IR35.

Qualifications

• Experience in ETL development and data engineering.
• Proficiency with distributed data processing tools (Spark/NiFi/Kafka).
• Strong knowledge of relational and NoSQL databases.
• Cloud data services (AWS).
• Experience with Palantir Foundry is a plus.
• Stakeholder engagement and collaboration skills.

Responsibilities

• Design and build data ingestion pipelines and orchestration tooling.
• Develop database schemas and data models.
• Integrate and enrich data from multiple sources ensuring quality and consistency.
• Design and implement ETL processes (e.g. using NiFi).
• Write clean, secure, test-driven code reusable by teams.
• Maintain and enhance data ingestion and storage architectures.
• Investigate and resolve data issues in production environments.
• Translate user needs into technical requirements for epics and stories.
• Implement data security controls and monitor performance.

Skills

ETL development

Python

Stakeholder engagement

Distributed computing

Cloud services

Palantir Foundry

Tools

NiFi

Apache Spark

Kafka

PostgreSQL

MySQL

MongoDB

Cassandra

AWS

Job description

Searchability NS&D in London is seeking an eDV-cleared Data Engineer to design and deliver mission-critical data services for national security clients. You will build robust data pipelines that process batch, streaming and real-time data to enable analytics at scale.

Responsibilities include ETL development, data modeling, data integration and security controls. The role is a 12-month, full-time on-site engagement in Central London with a daily rate of £680 inside IR35.