Data Engineer — National Security Data Pipelines

Roke; Woking; On-site; GBP 45,000 - 65,000; Full time

Job summary

A leading technology company in Woking is looking for a Data Engineer. You will be responsible for developing data pipelines, ensuring data consistency, and integrating information from various sources while implementing data security measures. The ideal candidate should have expertise in ETL processing, relational, and NoSQL databases, as well as experience in AWS services. This position requires eligibility for DV clearance and offers a chance to work with cutting-edge technology within the National Security domain.

Qualifications

• Experience in data pipeline development and orchestration design.
• Knowledge of database schema design and modelling.
• Proficiency in ETL processing design and coding.

Responsibilities

• Develop data ingestion and pipeline orchestration.
• Integrate and enrich data from various sources.
• Implement data security measures for sensitive information.

Skills

ETL processing languages such as Python

Apache Spark

NiFi

Kafka

Relational databases (PostgreSQL, MySQL)

NoSQL databases (MongoDB, Cassandra)

AWS and data-related services

Palantir Foundry

Job description

A leading technology company in Woking is looking for a Data Engineer. You will be responsible for developing data pipelines, ensuring data consistency, and integrating information from various sources while implementing data security measures. The ideal candidate should have expertise in ETL processing, relational, and NoSQL databases, as well as experience in AWS services. This position requires eligibility for DV clearance and offers a chance to work with cutting-edge technology within the National Security domain.