Job Title: Kafka Administrator
Location: Hyderabad / Bangalore (Onsite)
Experience: 5-10 Years
Job Summary
We are looking for an experienced Kafka Administrator to join our Enterprise Messaging and Middleware team. The ideal candidate will be responsible for the administration, support, monitoring, and optimization of Apache Kafka environments hosted on Azure Cloud and Kubernetes platforms. The role requires strong expertise in Kafka cluster management, Linux administration, cloud infrastructure, and container orchestration technologies.
Key Responsibilities
- Install, configure, administer, and support Apache Kafka clusters across development, testing, and production environments.
- Ensure high availability, scalability, reliability, and performance of Kafka platforms.
- Manage Kafka brokers, topics, partitions, replication, retention policies, and consumer groups.
- Deploy, manage, and maintain Kafka clusters in Kubernetes environments (AKS preferred).
- Administer Kafka infrastructure hosted on Microsoft Azure.
- Perform Kafka upgrades, migrations, patching, and capacity planning activities.
- Monitor cluster health and proactively identify performance bottlenecks.
- Troubleshoot production issues and provide root cause analysis for incidents.
- Implement security standards including SSL/TLS, SASL, ACLs, authentication, and authorization controls.
- Configure and manage Kafka Connect, Schema Registry, MirrorMaker, and related ecosystem tools.
- Collaborate with DevOps, Infrastructure, and Application teams for Kafka onboarding and support.
- Develop automation scripts and operational runbooks to improve platform efficiency.
- Support disaster recovery planning, backup strategies, and business continuity requirements.
Required Technical Skills
Apache Kafka
- 5+ years of hands-on experience in Kafka Administration.
- Strong understanding of Kafka architecture and distributed systems.
- Experience managing:
- Kafka Brokers
- Topics & Partitions
- Replication
- Consumer Groups
- Kafka Connect
- Schema Registry
- MirrorMaker
- Experience in Kafka performance tuning, troubleshooting, and capacity planning.
Microsoft Azure
- Hands-on experience working with Azure Cloud services.
- Knowledge of:
- Azure Virtual Machines
- Azure Networking
- Azure Storage
- Azure Monitor
- Azure Log Analytics
- Azure Kubernetes Service (AKS)
- Experience deploying and supporting Kafka workloads on Azure infrastructure.
Kubernetes
- Strong experience with Kubernetes administration.
- Hands-on expertise in:
- AKS (Azure Kubernetes Service)
- StatefulSets
- Deployments
- Helm Charts
- Persistent Volumes
- Ingress Controllers
- Container Networking
- Experience managing containerized Kafka deployments.
Linux Administration
- Strong administration experience in Linux environments (RHEL/CentOS/Ubuntu).
- Expertise in:
- System Administration
- Shell Scripting
- Process & Performance Monitoring
- User & Access Management
- Storage & File System Management
- Network Troubleshooting