Data DevOps Engineer

Careernet; Hyderabad; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Careernet is seeking an experienced Kafka/Confluent Platform engineer to provide hands-on support and operational readiness for developer teams. The role covers cluster administration, tuning for performance, and high availability, with responsibilities for Schema Registry, Avro serialization, and Kafka Connect operations.

Expertise in Kafka security (RBAC/ACLs), SSL/SASL, and incident troubleshooting is required.

Qualifications

• Bachelor's Degree in Computer Science or related field.
• 7–12 years of relevant experience in Kafka/Confluent platform operations and data streaming platform support.
• Apache Kafka and Confluent Platform (7+ years) with strong hands-on operational support.

Responsibilities

• Provide hands-on support for Apache Kafka and Confluent Platform environments, including operational readiness for developer teams.
• Administer and tune Kafka clusters: configuration, monitoring, performance tuning, and high availability.
• Implement and manage Schema Registry and data serialization using Avro (and related serialization patterns).
• Support Kafka Connect and connector operations, including troubleshooting end-to-end data flow issues.
• Manage Kafka security and access control using RBAC/ACLs and security mechanisms (e.g., SSL/SASL), and troubleshoot security-related incidents.

Skills

Rbac

Data Security

AVR

Data architecture

Kafka

Shell Scripting

Python

Splunk

Dynatrace

Grafana

Education

Bachelor's Degree in Computer Science or related field

Tools

Kafka

Confluent Platform

Schema Registry

Avro

Kafka Connect

SSL/SASL

Job description

Key Skills

Rbac, Data Security, AVR, Data architecture, Kafka, Shell Scripting, Python, Splunk, Dynatrace, Grafana

Roles and Responsibilities

• Provide hands‑on support for Apache Kafka and Confluent Platform environments, including operational readiness for developer teams.
• Administer and tune Kafka clusters: configuration, monitoring, performance tuning, and high availability.
• Implement and manage Schema Registry and data serialization using Avro (and related serialization patterns).
• Support Kafka Connect and connector operations, including troubleshooting end‑to‑end data flow issues.
• Manage Kafka security and access control using RBAC/ACLs and security mechanisms (e.g., SSL/SASL), and troubleshoot security‑related incidents.

Skills Required

• 7-12 years of relevant experience in Kafka/Confluent platform operations and data streaming platform support.
• Apache Kafka and Confluent Platform (7+ years) with strong hands‑on operational support.
• Confluent Cloud experience, including migration planning and execution from on‑prem Kafka.
• Kafka architecture and internals (topics, partitions, brokers, replication, consumer groups) with practical troubleshooting.
• Schema Registry with Avro, Kafka Connect, and Kafka security/access control; ability to perform version upgrades and patching with minimal downtime.

Good to Have

• Monitoring and observability tools such as Dynatrace, Splunk, and Grafana.
• Scripting and automation using Shell scripting and Python.

Education

Bachelor's Degree in Computer Science or related field.