Data Engineer - Secure Data Pipelines & Analytics

Roke Manor Research Ltd; Woking; Hybrid; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Hybrid working

Offices in Woking

Job summary

Roke Manor Research Ltd is seeking a Data Engineer to design and develop data pipelines that transform raw data into actionable insights for national security customers. You will work with batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets.

You will contribute to data ingestion, orchestration, schema design, and data security while collaborating with a scrum team on epics and stories.

Qualifications

• Experience building and maintaining data pipelines (ETL/ELT).
• Proficient in Python and distributed data processing.
• Knowledge of relational and NoSQL databases.

Responsibilities

• Design and implement data pipelines and orchestration solutions.
• Model database schemas and data stores for scalable analytics.
• Integrate data from diverse sources and ensure quality and security.

Skills

Python

Apache Spark

NiFi

Kafka

PostgreSQL

MongoDB

AWS

Palantir Foundry

Tools

Palantir Foundry

AWS

Job description

Roke Manor Research Ltd is seeking a Data Engineer to design and develop data pipelines that transform raw data into actionable insights for national security customers. You will work with batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets.

You will contribute to data ingestion, orchestration, schema design, and data security while collaborating with a scrum team on epics and stories.