Data Engineer, Security Platforms (DV Eligible)

Roke; Romsey; On-site; GBP 60,000 - 90,000; Full time

Benefits offered by this job

30 days’ holiday + bank holidays

Flexible working

On-site gym

Job summary

Roke in Romsey is seeking a Data Engineer to design and build high-performance data platforms that turn raw data into actionable intelligence, powering national security missions.

You will work with Data Scientists, Analysts and Platform Engineers to deliver end-to-end data pipelines, batch and streaming solutions, and robust governance in sensitive environments, applying secure coding, TDD and CI/CD to keep systems reliable.

Qualifications

• Experience building data pipelines and data platforms.
• Proficient in Python programming.
• Familiar with SDLC/DevSecOps practices.
• Experience with Elasticsearch.
• Experience working with large-scale or high-throughput datasets.

Responsibilities

• Design and build scalable data pipelines and ingestion frameworks.
• Develop batch and real-time streaming solutions using distributed systems.
• Integrate and enrich data from diverse, high-volume sources.
• Use of AI and LLM models to triage datasets.
• Create and optimise data models, schemas and storage solutions.
• Build and maintain ETL/ELT pipelines using Apache NiFi, Kafka and Python.
• Write secure, testable and maintainable code using modern engineering practices (TDD, CI/CD).
• Support and evolve data platforms, including ingestion services, streaming technologies and data stores.
• Monitor, troubleshoot and optimise pipeline performance and reliability.
• Collaborate with Data Scientists, Analysts and Platform Engineers to deliver end-to-end solutions.
• Contribute to agile delivery, including backlog refinement and story development.
• Apply robust data governance, quality and security controls for sensitive environments.

Skills

Python

Docker

Kubernetes

DevSecOps

Elasticsearch

Data pipelines

CI/CD

SDLC

Tools

Apache NiFi

Kafka

Job description

Roke in Romsey is seeking a Data Engineer to design and build high-performance data platforms that turn raw data into actionable intelligence, powering national security missions.

You will work with Data Scientists, Analysts and Platform Engineers to deliver end-to-end data pipelines, batch and streaming solutions, and robust governance in sensitive environments, applying secure coding, TDD and CI/CD to keep systems reliable.