Kafka Engineer

CHK Blujay Technologies; Hyderabad; On-site; INR 1,200,000 - 1,600,000; Full time

Job summary

CHK Blujay Technologies is seeking an experienced Kafka support engineer to provide L2/L3 technical assistance for Kafka-based systems. You will troubleshoot clusters, brokers, producers, and consumers, addressing performance bottlenecks and latency issues while ensuring SLA adherence.

The role requires expertise in Kafka internals, Confluent components, and AWS; you will also contribute to automation and process improvements using Python, Shell scripts, Ansible, Terraform, and CI/CD tools.

Qualifications

• 3-5 years of experience working with Apache Kafka and Confluent Kafka.
• Strong knowledge of Kafka internals (brokers, zookeepers, partitions, replication, offsets).
• Experience with Kafka Connect, Schema Registry, REST Proxy, and Kafka security.

Responsibilities

• Provide L2/L3 technical support for Kafka-based systems.
• Troubleshoot cluster, broker, producer, and consumer issues.
• Diagnose and resolve performance bottlenecks, latency issues, and data inconsistencies.
• Handle incidents and ensure SLA adherence.

Skills

Kafka

Kafka internals

AWS

Automation scripting

DevOps practices

Docker/Kubernetes

Tools

Schema Registry

REST Proxy

Kafka Connect

Docker

Kubernetes

CI/CD tooling

Job description

Role & responsibilities

1. Customer Support & Issue Resolution

• Provide L2/L3 technical support for Kafka-based systems.
• Troubleshoot cluster, broker, producer, and consumer issues.
• Diagnose and resolve performance bottlenecks, latency issues, and data inconsistencies.
• Handle incidents and ensure SLA adherence.

2. Kafka & Confluent Platform Expertise

• Support and maintain:
• Apache Kafka clusters
• Confluent Platform components (Schema Registry, Kafka Connect, ksqlDB, Control Center)
• Assist customers with:
• Topic configurations
• Partitioning strategies
• Replication and fault tolerance

3.Debugging & Root Cause Analysis

• Conduct deep-dive investigations into system failures.
• Use logs, metrics, and traces to identify root causes.
• Provide postmortem reports and preventive recommendations.

4. Automation & Process Improvement

• Automate operational tasks using Python, Shell scripts, Ansible, Terraform.
• Develop runbooks, SOPs, and knowledge articles.
• Continuously improve support processes and efficiency.

Required Skills:

• 3-5 years of experience working with Apache Kafka and Confluent Kafka.
• Strong knowledge of Kafka internals (brokers, zookeepers, partitions, replication, offsets).
• Experience with Kafka Connect, Schema Registry, REST Proxy, and Kafka security.
• Hands-on experience with AWS (EC2, IAM, CloudWatch, S3, Lambda, VPC, Load balancers).
• Proficiency in scripting and automation using Terraform, Ansible, or similar tools.
• Familiarity with DevOps practices and tools (CI/CD pipelines, monitoring tools like Prometheus/Grafana, Splunk, Datadog etc).
• Experience with containerization (Docker, Kubernetes) is a plus.

Nice to Have:

• Confluent Certified Developer or Administrator.
• AWS Certified
• CICD (AWS Code Pipeline, Harness)
• Containers ( Docker, Kubernetes)