Data Engineer: Mission-Critical Data Pipelines

Roke; Woking; Hybrid; GBP 60,000 - 90,000; Full time

Job summary

Roke is seeking a Data Engineer in Woking to design and operate data pipelines that transform raw data into actionable insights for national security clients. You will handle diverse data sources, batch and streaming, applying distributed compute techniques to enable downstream analytics and reporting.

You’ll work with Python ETL, Spark, NiFi, Kafka, relational and NoSQL databases, AWS services, and Palantir Foundry, in a hybrid setup with occasional client-site work in the London area.

Qualifications

• Experience with data pipelines and ETL using Python.
• Experience with distributed processing (Spark) and data streaming (Kafka/NiFi).
• Experience with AWS data services and Palantir Foundry.

Responsibilities

• Data pipeline development and orchestration design and tooling.
• Database schema design and data modelling.
• Data integration and enrichment from multiple sources ensuring quality.
• ETL design and coding (NiFi).
• Write clean, reusable code and maintain existing components.

Skills

ETL Python

Spark/NiFi/Kafka

Relational databases

NoSQL databases

AWS

Palantir Foundry

Tools

PostgreSQL

MySQL

MongoDB

Cassandra

Job description

Roke is seeking a Data Engineer in Woking to design and operate data pipelines that transform raw data into actionable insights for national security clients. You will handle diverse data sources, batch and streaming, applying distributed compute techniques to enable downstream analytics and reporting.

You’ll work with Python ETL, Spark, NiFi, Kafka, relational and NoSQL databases, AWS services, and Palantir Foundry, in a hybrid setup with occasional client-site work in the London area.