Data Engineer

TN United Kingdom; Woking; On-site; GBP 40,000 - 80,000; Full time

Job summary

Join a forward-thinking company as a Data Engineer, where you will play a pivotal role in developing mission-critical data services for National Security. This role involves managing data pipelines, transforming raw data into valuable insights, and ensuring data security. You will collaborate with a dynamic team, tackling complex challenges while utilizing cutting-edge technology in AI, Cloud, and Big Data. With a strong focus on innovation and sustainability, this position offers a unique opportunity to contribute to the safety and security of the nation. If you are passionate about data and technology, this is the perfect opportunity for you!

Qualifications

• Experience in data pipeline development and ETL processes.
• Familiarity with database schema design and data integration.

Responsibilities

• Develop and manage data pipelines for mission-critical solutions.
• Integrate and enrich data from various sources ensuring quality.

Skills

ETL processing languages (Python)

Apache Spark

NiFi

Kafka

Relational databases (PostgreSQL, MySQL)

NoSQL databases (MongoDB, Cassandra)

AWS and data-related services

Palantir Foundry

Education

Bachelor's degree in Computer Science or related field

Tools

AWS

Apache NiFi

PostgreSQL

MySQL

MongoDB

Cassandra

Job description

National Security Business
Be part of a growing and highly trusted supplier into the NS domain working to deliver mission critical solutions helping to keep the nation safe, secure and prosperous.

Work on leading edge technology solutions in the following disciplines: AI & Data Science, Cyber, Cloud, Big Data, Software Development, DevOps, SRE, Platform Engineering.

Role
As a Data Engineer, you’ll be actively involved in development of mission critical technical solutions that focus on data services for our National Security customers.

As our next Data Engineer, you’ll be managing and developing data pipelines that transform raw data into valuable insights for Roke’s National Security customers, enabling downstream analytics and reporting. You’ll be working with diverse data sources (batch, streaming, real-time and unstructured), applying distributed compute techniques to handle large datasets.

Roke is a leading technology & engineering company with clients spanning National Security, Defence and Intelligence. You will work alongside our customers to solve their complex and unique challenges.

You will be responsible for

1. Data pipeline development - Data ingestion and pipeline orchestration design and tooling.
2. Database schema design / database modelling.
3. Data integration - Integrating and enriching data from various sources, ensuring data consistency and quality.
4. ETL processing design and coding - Extract transform and load processing such as NiFI.
5. Create code that is open by default and easy for others to reuse.
6. Maintain and develop existing architectural components including Data Ingest and Data Stores.
7. Work as part of an operational team investigating and diagnosing problems identified with integrated (enriched) data.
8. Explain the difference between user needs and the desires of the user.
9. Data security - Implementing data security measures to protect sensitive information.
10. Be able to help the scrum team decompose user requests and key results into epics and stories.
11. Writing clean, secure code following a test-driven approach.
12. Monitor and maintain - Monitor data systems for performance issues and make any necessary updates.

Relevant skills (but not a requirement to have all of these)

1. ETL processing languages such as Python.
2. Apache Spark / NiFi / Kafka.
3. Relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).
4. AWS and data-related services.
5. Palantir Foundry.

Built on over a 60-year heritage, Roke offers specialist knowledge in sensors, communications, cyber, and AI and ML. We change the way organisations think and act through dynamic insights from the analysis of multiple layers of data. We take care of the innovative, technical stuff that keeps everyone safe that’s our mission, passion, and motivation.

We have secured long term work, across the full spectrum, on the latest framework with the client, which provides the springboard for our ongoing growth and development in this domain, so join us on what will be an incredible growth journey.

Where you’ll work
You’ll find our Woking site in a modern building on the outskirts of London. Rated excellent for sustainability by BREEAM & Fitwel certified you’ll feel better for visiting. This site provides key links to our customers in London, is a 5-minute walk from the train station, has secure parking nearby and dedicated cycle storage.

There is an expectation that a significant proportion of your time will be spent working on customer sites in the London area.

Clearance
Due to the nature of this role, we require you to be eligible to achieve DV clearance. As a result, you should be a British Citizen and have resided in the U.K. for the last 10 years.

The Next Step...
Click apply, submitting an up-to-date CV. We look forward to hearing from you.