National Security Data Engineer: Pipelines & AI

Roke Manor Research Ltd; Romsey; On-site; GBP 65,000 - 90,000; Full time

Job summary

Roke Manor Research Ltd is seeking a Data Engineer to design and develop data pipelines and analytics for National Security customers, leveraging distributed compute to transform raw data into actionable insights.

You will work with diverse data sources, collaborate with customers and the scrum team, and ensure data security and quality. DV clearance eligibility is required for this role.

Qualifications

• Experience with Big Data technologies (Hadoop, Spark, Pig).
• Experience with AWS services.
• Experience with Apache NiFi.
• Proficiency in Python or Java.

Responsibilities

• Data pipeline development – Data ingestion and pipeline orchestration design and tooling.
• Data integration – Integrating and enriching data from various sources, ensuring data consistency and quality.
• Data analytics – Extracting valuable insights from data to provide customers with actionable intelligence.
• Data security – Implementing data security measures to protect sensitive information.
• Data systems – Monitoring for performance issues and making any necessary optimisations/updates.
• Helping the scrum team decompose user requests and key results into epics and stories.
• Writing clean, secure code following a test-driven approach.
• Creating code that is open by default and easy for others to reuse.

Skills

Big Data technologies

AWS

Apache NiFi

Python or Java

Job description

Roke Manor Research Ltd is seeking a Data Engineer to design and develop data pipelines and analytics for National Security customers, leveraging distributed compute to transform raw data into actionable insights.

You will work with diverse data sources, collaborate with customers and the scrum team, and ensure data security and quality. DV clearance eligibility is required for this role.