Senior Data Engineer

Advanced Resource Managers; United Kingdom; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading company seeks a Senior Account Consultant specializing in Data Engineering for the Defence and Aerospace sectors. This role involves designing secure data pipelines, ensuring compliance with security policies, and managing real-time data flows. The ideal candidate will have extensive experience with the Elastic Stack and Apache NiFi, along with knowledge of security practices for sensitive data handling. This is a 6-month contract position based in Bristol, offering competitive pay.

Qualifications

• Experience as a Data Engineer in secure environments.
• Expertise in the Elastic Stack for data processes.
• Familiarity with data governance and compliance standards.

Responsibilities

• Design and maintain secure data pipelines using Elastic Stack.
• Collaborate with architects to ensure data security compliance.
• Develop dashboards in Kibana for data-driven decision-making.

Skills

Data Engineering

Elastic Stack

Apache NiFi

Data Governance

Security Practices

Containerization

Tools

Docker

Kubernetes

Prometheus

Grafana

Job description

Advanced Resource Managers provided pay range

This range is provided by Advanced Resource Managers. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

Direct message the job poster from Advanced Resource Managers

Senior Account Consultant - Specialist in both Permanent & Contract recruiting for the Defence and Aerospace sectors.

Bristol

6-month contract

Paying up to £80p/h (Outside IR35)

*** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance ***

Responsibilities:

• Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi.
• Implement data ingestion, transformation, and integration processes, ensuring data quality and security.
• Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards.
• Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity.
• Develop robust data models to support analytics and reporting within secure environments.
• Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack.
• Build dashboards and visualizations in Kibana to enable data-driven decision-making.
• Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies.
• Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness.

Experience required:

• Experience working as a Data Engineer in secure or regulated environments.
• Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization.
• Strong experience with Apache NiFi for building and managing complex data flows and integration processes.
• Familiarity with containerization and orchestration tools such as Docker and Kubernetes.
• Experience with monitoring and alerting tools such as Prometheus, Grafana, or ELK for data infrastructure
• Knowledge of security practices for handling sensitive data, including encryption, anonymization, and access control.
• Familiarity with data governance, data quality management, and compliance standards in secure environments.
• Experience in managing large-scale, real-time data pipelines and ensuring their performance and reliability.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Engineering and Project Management

• Industries

  Aviation and Aerospace Component Manufacturing, Military and International Affairs, and Data Infrastructure and Analytics

Referrals increase your chances of interviewing at Advanced Resource Managers by 2x

Get notified about new Data Engineer jobs in Greater Bristol Area, United Kingdom.

Bristol, England, United Kingdom 3 weeks ago

Bristol, England, United Kingdom 1 day ago

Bristol, England, United Kingdom 1 month ago

City Of Bristol, England, United Kingdom 4 days ago

Bristol, England, United Kingdom 3 weeks ago

Software Engineer - GVA and Camera integration - Outside IR35

Bristol, England, United Kingdom 1 week ago

Bristol, England, United Kingdom 2 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.