Kafka Platform Lead – Data Streaming, Cloud Infra & COE

Indsafri; South Africa; On-site; ZAR 900,000 - 1,200,000; Full time

Job summary

Indsafri is seeking an experienced Technology/Domain Specialist - Kafka to own the evolution and long-term health of our mission-critical streaming infrastructure. You will lead architecture, deployment, and optimization of our Kafka ecosystem, serving as a key leader within the COE to drive best practices and ensure scalability, security, and performance.

You will manage and maintain Kafka environments (Confluent Platform/Cloud), develop CI/CD pipelines and IaC with Terraform and Ansible, and

Qualifications

• 6+ years of professional experience in Systems or Platform Engineering.
• 4+ years of hands-on Kafka administration with Confluent Platform and/or Confluent Cloud.
• Cloud experience with a preference for Microsoft Azure.
• Proficient in Python and Bash scripting; infrastructure automation with Terraform/Ansible.
• Advanced Linux system administration, including troubleshooting and performance tuning.
• Strong understanding of Kafka security mechanisms (encryption, authentication, authorization).
• Hands-on observability experience (Prometheus/Grafana, ELK, Splunk, or Azure Monitor).

Responsibilities

• Own the lifecycle and architectural evolution of Kafka-based assets and related streaming platforms.
• Lead the COE as a technical leader, setting standards for platform reliability.
• Manage, configure, and maintain robust Kafka environments (Confluent Platform/Cloud) with high availability and performance.
• Lead CI/CD pipelines and infrastructure-as-code initiatives using Terraform and Ansible.
• Design and implement monitoring and alerting for health metrics using Prometheus, Grafana, ELK, or Azure Monitor.
• Enforce security protocols including TLS/SSL, SASL authentication, and ACL management.

Skills

Kafka

Azure

Python

Bash

Linux

Security

Monitoring

Kubernetes

Prometheus

Grafana

Tools

Terraform

Ansible

Job description

Indsafri is seeking an experienced Technology/Domain Specialist - Kafka to own the evolution and long-term health of our mission-critical streaming infrastructure. You will lead architecture, deployment, and optimization of our Kafka ecosystem, serving as a key leader within the COE to drive best practices and ensure scalability, security, and performance.

You will manage and maintain Kafka environments (Confluent Platform/Cloud), develop CI/CD pipelines and IaC with Terraform and Ansible, and