Hybrid Data Engineer: National Security Data Pipelines

Roke; Woking; Hybrid; GBP 65,000 - 95,000; Full time

Benefits offered by this job

Hybrid working

Competitive salary

Career development

Job summary

Roke in Woking is seeking a Data Engineer to design and build data pipelines for national security projects. You’ll transform raw data from batch, streaming, and unstructured sources into actionable insights using Spark, NiFi, Kafka, and AWS services.

Join a mission-driven team that values secure, scalable data solutions, and supports ongoing development with a hybrid working model including office and client-site opportunities. DV clearance will be required.

Qualifications

• Experience building data pipelines and data integration solutions.
• Strong knowledge of data modeling and data warehousing concepts.
• Experience with cloud-based data services and security practices.

Responsibilities

• Design and implement data pipelines for batch and streaming data.
• Develop and optimize database schemas and data stores.
• Integrate data from diverse sources and ensure data quality and consistency.
• Implement ETL/ELT processing using tools like NiFi and Spark.
• Write clean, secure, testable code and promote reusability.
• Monitor data systems and troubleshoot performance issues.

Skills

Python

Apache Spark

NiFi

Kafka

PostgreSQL

MySQL

MongoDB

Cassandra

AWS

Palantir Foundry

Job description

Roke in Woking is seeking a Data Engineer to design and build data pipelines for national security projects. You’ll transform raw data from batch, streaming, and unstructured sources into actionable insights using Spark, NiFi, Kafka, and AWS services.

Join a mission-driven team that values secure, scalable data solutions, and supports ongoing development with a hybrid working model including office and client-site opportunities. DV clearance will be required.