Kafka Admin

V2 Solutions; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

V2 Solutions in Hyderabad is seeking an experienced Kafka engineer to design, deploy, and manage large-scale Kafka clusters across on‑premise and cloud environments.

You will lead architecture decisions for HA, performance tuning, security, and DR, and mentor engineers while automating infrastructure with Terraform, Ansible, or scripts.

A solid grounding in Linux, Kafka internals, and streaming pipelines is essential.

Qualifications

• Bachelor's degree in CS/IT or equivalent practical experience.
• 5–9 years IT experience with at least 3+ years Kafka administration/engineering.
• Strong understanding of distributed systems and event streaming.

Responsibilities

• Design, deploy, and manage large-scale Kafka clusters across on-premise and cloud.
• Lead architecture decisions for high availability, scalability, and fault tolerance.
• Monitor, troubleshoot, and optimize Kafka clusters for performance and uptime.
• Handle capacity planning, cluster sizing, and performance tuning.
• Manage advanced configurations including multi-cluster replication (MirrorMaker), tiered storage, and KRaft mode.
• Configure and enforce security best practices (SASL, SSL/TLS, RBAC, ACLs).
• Implement robust backup, disaster recovery, and failover strategies.
• Collaborate with engineering teams to design efficient event-driven architectures and streaming pipelines.
• Resolve complex production issues and lead root cause analysis (RCA).
• Automate infrastructure provisioning and operational tasks using tools like Terraform, Ansible, or scripts.
• Lead Kafka upgrades, migrations, and platform enhancements with minimal downtime.
• Establish and maintain monitoring, alerting, and logging frameworks.
• Mentor junior engineers and provide technical leadership.
• Create and maintain detailed documentation and operational runbooks.

Skills

Kafka administration

Linux/Unix

Mentoring/leadership

Problem solving

English communication

Education

Bachelor's degree in Computer Science/IT

Tools

Kafka Connect, Kafka Streams, Schema Registry

Prometheus, Grafana, ELK, Splunk

Terraform, Ansible

Docker, Kubernetes

Python, Bash

AWS MSK, Azure Event Hubs/Kafka, GCP Pub/Sub-Kafka

Job description

Educational Requirements

Bachelor of Engineering Service Line Data Analytics Unit

Responsibilities

• Design, deploy, and manage large-scale Kafka clusters across on-premise and cloud environments
• Lead architecture decisions for high availability, scalability, and fault tolerance
• Monitor, troubleshoot, and optimize Kafka clusters to achieve optimal performance and uptime
• Handle capacity planning, cluster sizing, and performance tuning
• Manage advanced configurations including multi-cluster replication (MirrorMaker), tiered storage, and KRaft mode
• Configure and enforce security best practices (SASL, SSL/TLS, RBAC, ACLs)
• Implement robust backup, disaster recovery, and failover strategies
• Collaborate with engineering teams to design efficient event-driven architectures and streaming pipelines
• Resolve complex production issues and lead root cause analysis (RCA)
• Automate infrastructure provisioning and operational tasks using tools like Terraform, Ansible, or scripts
• Lead Kafka upgrades, migrations, and platform enhancements with minimal downtime
• Establish and maintain monitoring, alerting, and logging frameworks
• Mentor junior engineers and provide technical leadership
• Create and maintain detailed documentation and operational runbooks

Additional Responsibilities

• Bachelor's or Master's degree in Computer Science, IT, or a related field (or equivalent practical experience)

Technical and Professional Requirements

• Technology->Java->Apache 5-9 years of IT experience with at least 3+ years in Kafka administration/engineering
• Strong expertise in Apache Kafka internals (brokers, partitions, replication, ISR)
• Deep understanding of distributed systems, messaging frameworks, and event streaming
• Experience with Kafka ecosystem tools: Kafka Connect, Kafka Streams, Schema Registry
• Hands-on experience with monitoring tools like Prometheus, Grafana, ELK, or Splunk
• Strong Linux/Unix administration skills
• Experience with cloud platforms (AWS MSK, Azure Event Hubs/Kafka, GCP Pub/Sub-Kafka integration)
• Familiarity with containerization and orchestration (Docker, Kubernetes)
• Expertise in scripting/programming (Python, Bash, or Java preferred)
• Strong problem-solving skills with the ability to handle critical incidents

Preferred Skills

• Technology->Java->Apache->Kafka