Data Engineer

Roke; Romsey; On-site; GBP 60,000 - 90,000; Full time

Benefits offered by this job

30 days’ holiday + bank holidays

Flexible working

On-site gym

Job summary

Roke in Romsey is seeking a Data Engineer to design and build high-performance data platforms that turn raw data into actionable intelligence, powering national security missions.

You will work with Data Scientists, Analysts and Platform Engineers to deliver end-to-end data pipelines, batch and streaming solutions, and robust governance in sensitive environments, applying secure coding, TDD and CI/CD to keep systems reliable.

Qualifications

• Experience building data pipelines and data platforms.
• Proficient in Python programming.
• Familiar with SDLC/DevSecOps practices.
• Experience with Elasticsearch.
• Experience working with large-scale or high-throughput datasets.

Responsibilities

• Design and build scalable data pipelines and ingestion frameworks.
• Develop batch and real-time streaming solutions using distributed systems.
• Integrate and enrich data from diverse, high-volume sources.
• Use of AI and LLM models to triage datasets.
• Create and optimise data models, schemas and storage solutions.
• Build and maintain ETL/ELT pipelines using Apache NiFi, Kafka and Python.
• Write secure, testable and maintainable code using modern engineering practices (TDD, CI/CD).
• Support and evolve data platforms, including ingestion services, streaming technologies and data stores.
• Monitor, troubleshoot and optimise pipeline performance and reliability.
• Collaborate with Data Scientists, Analysts and Platform Engineers to deliver end-to-end solutions.
• Contribute to agile delivery, including backlog refinement and story development.
• Apply robust data governance, quality and security controls for sensitive environments.

Skills

Python

Docker

Kubernetes

DevSecOps

Elasticsearch

Data pipelines

CI/CD

SDLC

Tools

Apache NiFi

Kafka

Job description

Romsey | National Security | DV Clearance Eligibility Required

Make data matter where it counts

Join a growing team working at the forefront of UK National Security. We design and deliver advanced technology solutions that operate in some of the most complex and sensitive environments - helping keep the UK safe, secure, and resilient.

As a Data Engineer, you’ll play a key role in building high-performance data platforms that turn raw, complex data into actionable intelligence. You’ll use your key skills in Data Science and Data engineering. Your work will directly support critical national missions, powering decision-making, analytics, and machine learning at scale.

What you’ll be doing

• Design and build scalable data pipelines and ingestion frameworks
• Develop batch and real-time streaming solutions using distributed systems
• Integrate and enrich data from diverse, high-volume sources
• Use of AI and LLM models to triage datasets.
• Create and optimise data models, schemas and storage solutions
• Build and maintain ETL/ELT pipelines using tools like Apache NiFi, Kafka and Python
• Write secure, testable and maintainable code using modern engineering practices (TDD, CI/CD)
• Support and evolve data platforms, including ingestion services, streaming technologies and data stores
• Monitor, troubleshoot and optimise pipeline performance and reliability
• Collaborate with stakeholders including Data Scientists, Analysts and Platform Engineers to deliver end-to- end solutions
• Contribute to agile delivery, including backlog refinement and story development
• Apply robust data governance, quality and security controls appropriate for sensitive environments

What you’ll bring

• Building data pipelines and data platforms,
• Python
• SDLC / DevSecOps
• Elaticsearch
• Working with large-scale or high-throughput datasets
• Data modelling and schema design
• Monitoring and observability of data systems
• Experience of working in a customer facing role
• Containerisation and orchestration (Docker, Kubernetes)
• CI/CD and DevOps practices

Why Roke:

You’ll work with smart, supportive people on projects that genuinely matter, in an environment that values technical excellence, collaboration and continuous learning. We invest in your growth, value diverse thinking and offer flexible working alongside a strong benefits package (including 30 days’ holiday plus bank holidays). Roke combines a 70+ year heritage with the agility to make a real impact.

Location:

You’ll find our Romsey site located within beautiful Hampshire countryside, close to the picturesque New Forest District and not far from a superb stretch of the south coast. This is no corporate concrete jungle; this is a manor house site, with ample parking an on-site gym and a driveway full of daffodils in the spring.

Clearance:

This role requires candidates to hold valid DV clearance.

If you don’t currently hold DV clearance, but do meet the eligibility criteria, we’d love you to explore other engineering opportunities. Visit our Careers Page.

Eligibility Criteria:

Please refer to the gov.uk website for more information.