DV-Cleared Data Engineer: Elastic Stack & NiFi Specialist

LHH; United Kingdom; On-site; GBP 60,000 - 80,000; Part time

Job summary

A leading recruitment firm is looking for a Defence Lead in the United Kingdom to manage data pipelines and ensure compliance with security standards. The role requires expertise in the Elastic Stack and Apache NiFi, with responsibilities including designing, implementing, and maintaining secure data solutions. Candidates must have experience in regulated industries and be capable of developing end-to-end solutions. This is a contract position offering onsite work with options for compressed hours.

Qualifications

• Experience in government, defence, or regulated industries is essential.
• Familiarity with machine learning algorithms and their implementation.
• Confidence in developing secure data solutions.

Responsibilities

• Design and maintain secure data pipelines using the Elastic Stack.
• Collaborate with security teams for compliance with policies.
• Manage real-time data flows to ensure performance.

Skills

Data pipeline management

Elastic Stack (Elasticsearch, Logstash, Kibana)

Apache NiFi

Data quality and security

End-to-end solution development

Infrastructure as code

Container orchestration (Docker, Kubernetes)

ETL tools (Kafka, Spark, Hadoop)

Monitoring and alerting tools

Tools

Terraform

Ansible

Prometheus

Grafana

Job description

A leading recruitment firm is looking for a Defence Lead in the United Kingdom to manage data pipelines and ensure compliance with security standards. The role requires expertise in the Elastic Stack and Apache NiFi, with responsibilities including designing, implementing, and maintaining secure data solutions. Candidates must have experience in regulated industries and be capable of developing end-to-end solutions. This is a contract position offering onsite work with options for compressed hours.