Kafka Developer

Wissen Technology; Pune District, Mumbai; In loco; INR 3.500.000 - 5.500.000; Tempo pieno

Descrizione del lavoro

Wissen Technology is seeking a senior Kafka platform engineer to manage end-to-end Kafka deployments, including on-premises clusters in KRaft mode and CFK on Kubernetes. You will handle security, disaster recovery, and multi-region replication while ensuring high availability and observability with Prometheus and Grafana.

The role requires strong Java/Scala skills and Python scripting for tooling, plus experience with Kafka Connect and Schema Registry.

Competenze

• 8+ years in messaging/streaming platform engineering, with 5+ years on Apache Kafka platform engineering.
• Hands-on administration of self-managed on-prem Kafka clusters in KRaft mode.
• Confluent for Kubernetes (CFK): operator management and custom resource configuration.
• Kafka Connect: connector lifecycle, SMTs, and error handling.
• Confluent Schema Registry; schema evolution and compatibility modes.
• Kafka security: TLS/mTLS, SASL, and ACL configuration and troubleshooting.
• Proficiency in Java or Scala; Python for scripting and tooling.
• Observability: Prometheus, Grafana, and OpenTelemetry.

Mansioni

• Manage Kafka cluster lifecycle: provisioning, configuration tuning, upgrades, and decommissioning
• Deploy, operate, and maintain Kafka on Kubernetes using Confluent for Kubernetes (CFK)
• Monitor cluster health and set up alerting across consumer lag, broker health, and topic throughput
• Design and operate disaster recovery and multi-region replication strategies
• Enforce Kafka security policies including access reviews and ACL management
• Troubleshoot performance bottlenecks, consumer lag issues, and broker failures

Conoscenze

Kafka platform engineering

KRaft mode administration

Confluent for Kubernetes

Kafka Connect

Schema Registry

Kafka security TLS/mTLS SASL ACL

Java/Scala

Python scripting

Observability: Prometheus Grafana Open

Strumenti

Kubernetes

Confluent CFK

Kafka Connect

Schema Registry

TLS/SASL/ACL tooling

Prometheus

Grafana

OpenTelemetry

Java/Scala runtime

Python

Descrizione del lavoro

• Manage Kafka cluster lifecycle: provisioning, configuration tuning, upgrades, and decommissioning
• Deploy, operate, and maintain Kafka on Kubernetes using Confluent for Kubernetes (CFK)
• Monitor cluster health and set up alerting across consumer lag, broker health, and topic throughput
• Design and operate disaster recovery and multi-region replication strategies
• Enforce Kafka security policies including access reviews and ACL management
• Troubleshoot performance bottlenecks, consumer lag issues, and broker failures

Must Have

• 8+ years in messaging/streaming platform engineering, with 5+ years on Apache Kafka platform engineering
• Hands-on administration of self-managed on-premises Kafka clusters in KRaft mode
• Confluent for Kubernetes (CFK): operator management and custom resource configuration
• Kafka Connect: connector lifecycle, SMTs, and error handling
• Confluent Schema Registry; schema evolution and compatibility modes
• Kafka security: TLS/mTLS, SASL, and ACL configuration and troubleshooting
• Proficiency in Java or Scala; Python for scripting and tooling
• Observability: Prometheus, Grafana, and OpenTelemetry

Good to Have

• Apache Flink for complex event processing beyond Kafka Streams
• CDC pipelines into Kafka
• Operational experience with Mirror Maker 2 or Confluent Replicator in multi-DC setups
• Knowledge of event-driven architecture or data mesh principles
• Build and maintain infrastructure-as-code for Kafka resources