Data Engineer

Babcock; Bristol; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading company in security-focused data solutions is seeking a contract Data Engineer in Bristol. The role involves designing and managing robust data pipelines using Elastic Stack and Apache NiFi. Ideal candidates will have extensive experience in regulated industries and a track record of building scalable, secure data solutions.

Qualifications

• Minimum 3 years' experience as a Data Engineer in regulated industries.
• Proficiency in the full Elastic Stack and Apache NiFi.
• Solid scripting capabilities using Python, Bash, or similar.

Responsibilities

• Designing and deploying scalable data pipelines using Elastic Stack and Apache NiFi.
• Monitoring and optimizing high-throughput data flows across environments.
• Collaborating with architects to align with governance and compliance needs.

Skills

Data Engineering

Elasticsearch

Apache NiFi

Data Protection

Cloud Services

Scripting

Job description

DV (MOD) Cleared Data Engineer – Elastic Stack & Apache NiFi

Location:Bristol | Contract Type:£430.00 pd (Outside IR35) | Working Pattern:Hybrid (3 - 4 days on-site)

Are you a contract Data Engineer with a knack for designing secure, high-performance data solutions? We’re on the lookout for a technical expert in the Elastic Stack and Apache NiFi to take the lead in building robust, real-time data pipelines in a security-focused environment.

This is a hands-on contract opportunity to make a real impact—ideal for professionals with a strong track record in regulated sectors.

What You'll Be Doing

• Designing and deploying scalable, secure data pipelines using Elasticsearch, Logstash, Kibana, and Apache NiFi

• Handling real-time data ingestion and transformation with an emphasis on integrity and availability

• Collaborating with architects and cybersecurity stakeholders to align with governance and compliance needs

• Monitoring and optimising high-throughput data flows across on-prem and cloud environments

• Building insightful Kibana dashboards to support business intelligence and operational decision-making

• Maintaining documentation of data flows, architecture, and security procedures to ensure audit-readiness

Your Experience

Must-Have:

• Minimum 3 years' experience as a Data Engineer in sensitive or regulated industries

• Proficiency in the full Elastic Stack for data processing, analytics, and visualisation

• Hands-on expertise with Apache NiFi in designing sophisticated data workflows

• Solid scripting capabilities using Python, Bash, or similar

• Familiarity with best practices in data protection (encryption, anonymisation, access control)

• Experience managing large-scale, real-time data pipelines

• Working knowledge of cloud services (AWS, Azure, GCP), especially around secure deployment

Nice-to-Have:

• Background in government, defence, or highly regulated sectors

• Exposure to big data tools like Kafka, Spark, or Hadoop

• Understanding of containerisation and orchestration (e.g. Docker, Kubernetes)

• Familiarity with infrastructure as code tools (e.g. Terraform, Ansible)

• Experience building monitoring solutions with Prometheus, Grafana, or ELK

• Interest in or exposure to machine learning-driven data systems