Kafka Data Engineer

Zorba Consulting; Pune District; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Zorba Consulting in Pune (India) is seeking an experienced Kafka Data Engineer to lead migrations, set up cross-cluster replication, and optimize data streaming pipelines. You will work with MirrorMaker 2.0, Confluent tools, and cloud integrations to minimize downtime.

The role demands strong hands-on expertise in Kafka components (Connect, Streams, Schema Registry) and distributed systems, plus Linux, Python/Java/Scala proficiency. Knowledge of AWS MSK and Terraform is a plus.

Qualifications

• The role requires hands-on experience with Kafka Topic Migration and cluster-to-cluster replication using MirrorMaker 2.0, Confluent Replicator, or Cluster Linking.
• Strong knowledge of Kafka Connect, Kafka Streams, Schema Registry, and Confluent Platform is mandatory.
• The candidate should understand Kafka brokers, partitions, replication, consumer groups, offsets, ACLs, consumer lag, throughput, and latency.
• Experience with Linux/Unix and proficiency in Python, Java, or Scala is required.
• Candidates should have a strong understanding of distributed systems, event-driven architecture, and messaging systems.
• Exposure to cloud platforms such as AWS MSK, Azure Event Hubs/Kafka, or GCP Pub/Sub is preferred.
• Knowledge of Terraform, CI/CD, Docker, Kubernetes, Databricks, Spark Streaming, or Flink will be an added advantage.

Responsibilities

• The role requires hands-on experience with Kafka Topic Migration and cluster-to-cluster replication using MirrorMaker 2.0, Confluent Replicator, or Cluster Linking.
• Strong knowledge of Kafka Connect, Kafka Streams, Schema Registry, and Confluent Platform is mandatory.
• The candidate should understand Kafka brokers, partitions, replication, consumer groups, offsets, ACLs, consumer lag, throughput, and latency.
• Experience with Linux/Unix and proficiency in Python, Java, or Scala is required.
• Candidates should have a strong understanding of distributed systems, event-driven architecture, and messaging systems.
• Exposure to cloud platforms such as AWS MSK, Azure Event Hubs/Kafka, or GCP Pub/Sub is preferred.
• Knowledge of Terraform, CI/CD, Docker, Kubernetes, Databricks, Spark Streaming, or Flink will be an added advantage.

Skills

Apache Kafka

MirrorMaker 2.0

Confluent Replicator

Cluster Linking

Kafka Connect

Kafka Streams

Schema Registry

Confluent Platform

AWS MSK

Tools

Terraform

CI/CD

Docker

Kubernetes

Job description

Job Summary

We are looking for an experienced Kafka Data Engineer with strong hands-on expertise in Apache Kafka, Kafka Administration, Topic Migration, Cluster Migration, Data Streaming, and Distributed Systems. The candidate will be responsible for planning and executing Kafka migrations, cross-cluster replication, data validation, performance tuning, and ensuring minimal downtime.

Responsibilities

• The role requires hands-on experience with Kafka Topic Migration and cluster-to-cluster replication using MirrorMaker 2.0, Confluent Replicator, or Cluster Linking.
• Strong knowledge of Kafka Connect, Kafka Streams, Schema Registry, and Confluent Platform is mandatory.
• The candidate should understand Kafka brokers, partitions, replication, consumer groups, offsets, ACLs, consumer lag, throughput, and latency.
• Experience with Linux/Unix and proficiency in Python, Java, or Scala is required.
• Candidates should have a strong understanding of distributed systems, event-driven architecture, and messaging systems.
• Exposure to cloud platforms such as AWS MSK, Azure Event Hubs/Kafka, or GCP Pub/Sub is preferred.
• Knowledge of Terraform, CI/CD, Docker, Kubernetes, Databricks, Spark Streaming, or Flink will be an added advantage.

Skills & Competencies

• Apache Kafka
• MirrorMaker 2.0
• Confluent Replicator
• Cluster Linking
• Kafka Connect
• Kafka Streams
• Schema Registry
• Confluent Platform
• AWS MSK