Kafka Admin

Infosys; Hyderabad; On-site; INR 1,200,000 - 1,600,000; Full time

Job summary

Infosys in Hyderabad is seeking an experienced Apache Kafka Administrator to manage Kafka clusters and ensure high performance and availability. The ideal candidate will have over 5 years of experience in Kafka administration, a Bachelor of Engineering in a relevant field, and strong scripting skills.

This role involves monitoring, troubleshooting, and optimizing Kafka clusters while collaborating with development teams for scalable data solutions.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 5+ years of experience with Apache Kafka administration.
• Hands-on experience with Kafka ecosystem tools like Zookeeper and Kafka Connect.

Responsibilities

• Install, configure, and manage Apache Kafka clusters.
• Monitor Kafka cluster health and performance.
• Automate routine tasks using scripting and configuration management tools.

Skills

Apache Kafka administration

Distributed systems knowledge

Scripting knowledge (Bash, Python)

Monitoring tools (Prometheus, Grafana)

Education

Bachelor of Engineering in Computer Science or related field

Tools

Docker

Kubernetes

AWS

Azure

Job description

Educational Requirements

Bachelor of Engineering

Service Line

Data Analytics Unit

Responsibilities

• Install, configure, and manage Apache Kafka clusters in production and non production environments
• Monitor Kafka cluster health, performance, and capacity using tools such as Prometheus, Grafana, or similar
• Perform cluster tuning and optimization to ensure high throughput and low latency
• Manage Kafka topics, partitions, brokers, replication, and retention policies
• Implement and maintain data security, including authentication SASL, authorization ACLs, and encryption SSL TLS
• Troubleshoot and resolve Kafka related issues, including broker failures, consumer lag, and data inconsistencies
• Automate routine tasks using scripting Shell, Python, etc. and configuration management tools
• Work closely with development teams to design scalable and fault tolerant data streaming solutions
• Perform upgrades, patching, and maintenance with minimal downtime
• Ensure backup and disaster recovery mechanisms for Kafka clusters
• Maintain documentation for configurations, processes, and troubleshooting guides

Additional Responsibilities

• Bachelors degree in Computer Science, Information Technology, or a related field

Technical and Professional Requirements

• 25 years of experience working with Apache Kafka administration/support
• Strong understanding of distributed systems and messaging architectures
• Hands-on experience with Kafka ecosystem tools (Zookeeper/KRaft, Kafka Connect, Kafka Streams)
• Experience with monitoring tools such as Prometheus, Grafana, or ELK stack
• Knowledge of Linux/Unix systems administration
• Familiarity with cloud platforms like AWS, Azure, or GCP
• Experience with containerization and orchestration tools (Docker, Kubernetes) is a plus
• Understanding of data pipelines, ETL processes, and streaming concepts
• Strong troubleshooting and analytical skills
• Good scripting knowledge (Bash, Python, or similar)

Preferred Skills

• Java
• Apache
• Kafka