Kafka Designer

Tata Consultancy Services; Hyderabad; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Tata Consultancy Services in Hyderabad seeks an experienced IT professional to design and implement scalable Kafka-based streaming solutions. You will develop producers, consumers, and stream processing apps, and architect event-driven integrations to meet cross-functional requirements.

You'll configure and optimize Kafka clusters for high availability, ensure security and governance, and collaborate with cloud teams on AWS, Azure, or GCP deployments.

Qualifications

• 5+ years of IT experience with strong expertise in Apache Kafka.
• Experience in Kafka Architecture, Design, and Development.
• Hands-on experience with Kafka Producers & Consumers, Kafka Connect, Kafka Streams, and Schema Registry.
• Familiarity with Confluent Platform and ZooKeeper/KRaft.
• Strong knowledge of distributed systems and event-driven architecture.
• Experience with Java, Spring Boot, or Microservices.
• Familiarity with REST APIs and enterprise integration patterns.
• Knowledge of CI/CD, Git, and DevOps practices.
• Experience with cloud platforms such as AWS, Azure, or GCP is preferred.

Responsibilities

• Design and implement scalable, high-performance Kafka-based streaming solutions.
• Develop and maintain Kafka producers, consumers, and stream processing applications.
• Architect event-driven and message-driven integration solutions.
• Configure, monitor, and optimize Kafka clusters for high availability and performance.
• Work with cross-functional teams to define streaming and integration requirements.
• Implement data pipelines using Kafka Connect, Kafka Streams, and related technologies.
• Troubleshoot and resolve performance, scalability, and reliability issues.
• Ensure security, governance, and best practices for Kafka deployments.

Skills

Apache Kafka

Kafka Architecture

Kafka Design

Kafka Development

Java

Spring Boot

Microservices

REST APIs

CI/CD

Git

DevOps

Distributed systems

Event-driven architecture

AWS

Azure

GCP

Tools

Kafka Connect

Kafka Streams

Schema Registry

Confluent Platform

ZooKeeper

KRaft

Job description

Role & responsibilities

• Design and implement scalable, high-performance Kafka-based streaming solutions.
• Develop and maintain Kafka producers, consumers, and stream processing applications.
• Architect event-driven and message-driven integration solutions.
• Configure, monitor, and optimize Kafka clusters for high availability and performance.
• Work with cross-functional teams to define streaming and integration requirements.
• Implement data pipelines using Kafka Connect, Kafka Streams, and related technologies.
• Troubleshoot and resolve performance, scalability, and reliability issues.
• Ensure security, governance, and best practices for Kafka deployments.

Required Skills

• 5+ years of IT experience with strong expertise in Apache Kafka.
• Experience in Kafka Architecture, Design, and Development.
• Hands-on experience with:
• Kafka Producers & Consumers
• Kafka Connect
• Kafka Streams
• Schema Registry
• Confluent Platform
• ZooKeeper/KRaft
• Strong knowledge of distributed systems and event-driven architecture.
• Experience with Java, Spring Boot, or Microservices.
• Familiarity with REST APIs and enterprise integration patterns.
• Knowledge of CI/CD, Git, and DevOps practices.
• Experience with cloud platforms such as AWS, Azure, or GCP is preferred.