Kafka Administrator

Purview Services; Coimbatore District; On-site; INR 2,600,000 - 4,000,000; Full time

Job summary

Purview Services in India seeks an experienced Kafka/Observability engineer to design, build, and operate streaming platforms for logs, metrics, and traces.

You will optimize Kafka clusters, implement security, and help integrate OpenTelemetry pipelines across the observability stack, ensuring end-to-end reliability.

Qualifications

• 5+ years of hands-on experience with Apache Kafka in production environments.
• Strong knowledge of Kafka architecture: brokers, partitions, replication, consumer groups, offsets.
• Hands-on experience with Kafka security (SSL/TLS, SASL).
• Strong hands-on experience with OpenTelemetry pipelines and collectors.
• Experience integrating logs, metrics, and traces into a unified observability platform.
• Proven expertise in performance tuning and production troubleshooting.
• Experience managing enterprise-scale data or observability platforms.

Responsibilities

• Design, build, and operate Kafka-based streaming platforms for logs, metrics, and traces.
• Configure and optimize Kafka clusters including brokers, topics, partitions, replication, and consumer groups.
• Implement and manage Kafka security using SSL/TLS and SASL mechanisms.
• Design and operate OpenTelemetry pipelines and collectors for metrics, logs, and distributed tracing.
• Integrate telemetry data across logs, metrics, and traces for end-to-end observability.
• Perform performance tuning, capacity planning, and reliability improvements for Kafka and OTel pipelines.
• Troubleshoot complex production issues across Kafka, OpenTelemetry collectors, and downstream systems.
• Manage and operate data/telemetry platforms ensuring stability, scalability, and compliance.
• Collaborate with platform, SRE, and application teams to support enterprise observability use cases.

Skills

Apache Kafka

Kafka security (SSL/TLS,SASL)

OpenTelemetry

Observability platforms

Production troubleshooting

Tools

Kafka

OpenTelemetry

Job description

Role & responsibilities

Key Responsibilities

Design, build, and operate Kafka-based streaming platforms for logs, metrics, and traces.

Configure and optimize Kafka clusters including brokers, topics, partitions, replication, and consumer groups.

Implement and manage Kafka security using SSL/TLS and SASL mechanisms.

Design and operate OpenTelemetry pipelines and collectors for metrics, logs, and distributed tracing.

Integrate telemetry data across logs, metrics, and traces for end-to-end observability.

Perform performance tuning, capacity planning, and reliability improvements for Kafka and OTel pipelines.

Troubleshoot complex production issues across Kafka, OpenTelemetry collectors, and downstream systems.

Manage and operate data/telemetry platforms ensuring stability, scalability, and compliance.

Collaborate with platform, SRE, and application teams to support enterprise observability use cases.

Mandatory Skills (Must-Have)

5+ years of hands-on experience with Apache Kafka in production environments.

Strong knowledge of Kafka architecture: brokers, partitions, replication, consumer groups, offsets.

Hands-on experience with Kafka security (SSL/TLS, SASL).

Strong hands-on experience with OpenTelemetry pipelines and collectors.

Experience integrating logs, metrics, and traces into a unified observability platform.

Proven expertise in performance tuning and production troubleshooting.

Experience managing enterprise-scale data or observability platforms.