Data Platform Engineer - DV Cleared

CBSbutler Holdings Limited trading as CBSbutler; Wychavon; On-site; GBP 80,000 - 100,000; Part time

Job summary

A leading UK tech company is seeking a Data Platform Engineer to build and manage data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. This role involves ensuring compliance with stringent security standards while designing robust data solutions. The successful candidate will troubleshoot and optimize data flows, develop data models for analytics, and create dashboards in Kibana. This onsite role offers the possibility of compressed hours, ensuring flexibility while adhering to data governance requirements.

Qualifications

• Strong expertise in building and managing data pipelines.
• Experience with Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi.
• Ability to ensure compliance with security policies and data governance standards.

Responsibilities

• Design, develop, and maintain secure and scalable data pipelines.
• Implement data ingestion, transformation, and integration processes.
• Collaborate with data architects and security teams.
• Manage and monitor large-scale data flows in real-time.
• Develop robust data models for analytics and reporting.
• Perform troubleshooting and performance tuning of data pipelines.
• Build dashboards and visualizations in Kibana.
• Ensure high availability and disaster recovery for data systems.
• Document data architecture and workflows.

Skills

Building and managing data pipelines

Elastic Stack (Elasticsearch, Logstash, Kibana)

Apache NiFi

Data quality and security

Real-time data flow management

Data models for analytics

Troubleshooting and performance tuning

Job description

Data Platform Engineer DV Cleared

£500 - £600 per day - Outside IR35

JOB DESCRIPTION

This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. This is a UK based onsite role with the option of compressed hours.

• Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi.
• Implement data ingestion, transformation, and integration processes, ensuring data quality and security.
• Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards.
• Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity.
• Develop robust data models to support analytics and reporting within secure environments.
• Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack.
• Build dashboards and visualizations in Kibana to enable data-driven decision-making.
• Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies.
• Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness