Kafka Administrator

Purview Services; Indore District; On-site; INR 3,000,000 - 5,600,000; Full time

Job summary

Purview Services in India is seeking a senior observability engineer to design, build, and operate Kafka-based streaming platforms for logs, metrics, and traces. You will configure clusters, implement security, and ensure end-to-end telemetry across the stack.

The role requires deep hands-on experience with Apache Kafka in production, strong knowledge of OpenTelemetry, and the ability to troubleshoot complex production issues while driving performance and reliability at scale.

Qualifications

• 5+ years hands-on Apache Kafka in production environments.
• Kafka architecture knowledge: brokers, partitions, replication, consumer groups, offsets.
• Hands-on SSL/TLS and SASL Kafka security.
• OpenTelemetry pipelines and collectors expertise.
• Experience integrating logs, metrics, and traces into a unified observability platform.
• Production troubleshooting and performance tuning in enterprise-scale data platforms.

Responsibilities

• Design, build, and operate Kafka-based streaming platforms for logs, metrics, and traces.
• Configure and optimize Kafka clusters, including brokers, topics, partitions, replication, and consumer groups.
• Implement and manage Kafka security using SSL/TLS and SASL.
• Design and operate OpenTelemetry pipelines and collectors for metrics, logs, and distributed tracing.
• Integrate telemetry data across logs, metrics, and traces for end-to-end observability.
• Perform performance tuning, capacity planning, and reliability improvements for Kafka and OpenTelemetry pipelines.
• Troubleshoot complex production issues across Kafka, OpenTelemetry collectors, and downstream systems.
• Manage and operate data/telemetry platforms ensuring stability, scalability, and compliance.
• Collaborate with platform, SRE, and application teams to support enterprise observability use cases.

Skills

Kafka production

Kafka architecture

Kafka security

OpenTelemetry

Observability

Performance tuning

Troubleshooting

Data platforms

Job description

Role & responsibilities

Key Responsibilities

Design, build, and operate Kafka-based streaming platforms for logs, metrics, and traces.

Configure and optimize Kafka clusters including brokers, topics, partitions, replication, and consumer groups.

Implement and manage Kafka security using SSL/TLS and SASL mechanisms.

Design and operate OpenTelemetry pipelines and collectors for metrics, logs, and distributed tracing.

Integrate telemetry data across logs, metrics, and traces for end-to-end observability.

Perform performance tuning, capacity planning, and reliability improvements for Kafka and OTel pipelines.

Troubleshoot complex production issues across Kafka, OpenTelemetry collectors, and downstream systems.

Manage and operate data/telemetry platforms ensuring stability, scalability, and compliance.

Collaborate with platform, SRE, and application teams to support enterprise observability use cases.

Mandatory Skills (Must-Have)

5+ years of hands-on experience with Apache Kafka in production environments.

Strong knowledge of Kafka architecture: brokers, partitions, replication, consumer groups, offsets.

Hands-on experience with Kafka security (SSL/TLS, SASL).

Strong hands-on experience with OpenTelemetry pipelines and collectors.

Experience integrating logs, metrics, and traces into a unified observability platform.

Proven expertise in performance tuning and production troubleshooting.

Experience managing enterprise-scale data or observability platforms.