Kafka Engineer

Virtusa; Hyderabad; Presencial; INR 1 800 000 - 2 200 000; Tempo integral

Resumo da oferta

Virtusa in Hyderabad seeks a Kafka Operations Engineer to manage and scale Kafka clusters with a focus on availability and governance. You will implement topic governance, ACLs/RBAC, and security, while integrating metrics into observability dashboards.

The role emphasizes cross-site replication, TLS/SASL security, and incident response to ensure resilient data pipelines.

Qualificações

• Experience with Kafka operations and cluster management.
• Hands-on with high availability, cross-site replication and ZooKeeper.
• Experience with Confluent Schema Registry or equivalent governance.
• Strong observability using Prometheus, logging, and related tools.

Responsabilidades

• Operate and scale Kafka clusters reliably.
• Ensure HA and cross-site replication.
• Implement governance, topic management, and secure access.
• Integrate and monitor Kafka metrics/logs into observability dashboards.
• Ensure proper ACLs and RBAC for producers/consumers.
• Respond to Kafka-related incidents and outages.

Conhecimentos

Kafka Operations

Cluster Management

Schema Registry

Monitoring

Security

Integration APIs

Ferramentas

Prometheus JMX Exporter

Dynatrace Kafka plugins

Elastic

Descrição da oferta de emprego

• Kafka Operations: Confluent Kafka ; cluster setup and maintenance.
• Cluster Management: High availability, cross-site replication,ZooKeeper.
• Schema Registry & Topic Governance: Confluent Schema Registry or equivalent.
• Security: TLS, SASL, ACLs, RBAC.
• Integration & APIs: Kafka REST API, connectors.

Job Requirements

Experience: 4–6 years

Required Skills

• Kafka Operations: Confluent Kafka ; cluster setup and maintenance.
• Cluster Management: High availability, cross-site replication,ZooKeeper.
• Schema Registry & Topic Governance: Confluent Schema Registry or equivalent.
• Monitoring: Prometheus JMX Exporter, Dynatrace Kafka plugins, Elastic.
• Security: TLS, SASL, ACLs, RBAC.
• Integration & APIs: Kafka REST API, connectors.

Key Concepts

• Event-driven architecture and distributed system principles.
• Performance tuning and throughput optimization.
• Disaster recovery strategies for Kafka clusters.
• Governance, schema evolution, and topic lifecycle management.

Key Responsibilities

• Operate and scale Kafka clusters reliably.
• Ensure HA and cross-site replication.
• Implement governance, topic management, and secure access.
• Integrate and monitor Kafka metrics/logs into observability dashboards.
• Ensure proper ACLs and RBAC policies for producers/consumers
• Respond to Kafka-related incidents and outages

Work Experience

2-5Years