Senior Data Engineer - DV Cleared

TieTalent; Bristol; On-site; GBP 40,000 - 80,000; Full time

Job summary

An established industry player is seeking a skilled professional to build and manage data pipelines using the Elastic Stack and Apache NiFi. In this exciting role, you will design and implement scalable data solutions while ensuring compliance with security standards. You will collaborate with data architects to manage large-scale data flows in real-time, ensuring performance and reliability. This UK-based onsite position offers the option of compressed hours, allowing for flexibility in your work schedule. If you are passionate about data management and want to make a significant impact, this opportunity is perfect for you.

Qualifications

• Strong expertise in building and managing data pipelines.
• Experience with Elastic Stack and Apache NiFi is essential.

Responsibilities

• Design and maintain secure data pipelines using the Elastic Stack.
• Collaborate with teams to ensure compliance with security policies.

Skills

Data Pipeline Management

Elastic Stack (Elasticsearch, Logstash, Kibana)

Apache NiFi

Data Quality Assurance

Data Governance

Tools

Kibana

Elasticsearch

Logstash

Apache NiFi

Job description

This job offer is presented to you through one of our partners. Click on "Show interest" to be redirected.

Partner Job: CBSbutler Holdings Limited trading as CBSbutler

JOB DESCRIPTION

This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. This is a UK based onsite role with the option of compressed hours. The role will include:

1. Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi.
2. Implement data ingestion, transformation, and integration processes, ensuring data quality and security.
3. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards.
4. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity.
5. Develop robust data models to support analytics and reporting within secure environments.
6. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack.
7. Build dashboards and visualizations in Kibana to enable data-driven decision-making.
8. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies.
9. Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness.