Job Opening For Kafka Administrator

Mindgate Solutions; Navi Mumbai; On-site; INR 1,400,000 - 2,100,000; Full time

Job summary

Mindgate Solutions is seeking a Kafka Administrator / Confluent Kafka Engineer with 6+ years of experience to manage and support distributed streaming platforms. The role focuses on administering Kafka clusters, securing data, and enabling seamless data integration across cloud-native environments.

You will maintain high availability, manage Kafka Connect, and collaborate with DevOps and cloud teams to orchestrate containers (Docker/Kubernetes) and cloud provisioning (AWS, Azure, GCP), ensuring

Qualifications

• 6+ years of hands-on experience in Confluent Kafka administration and support.

Responsibilities

• Design, deploy, and administer multi-node Confluent Kafka clusters ensuring high availability and fault tolerance.
• Manage Kafka Connect (Source & Sink) for efficient data streaming across systems.
• Implement and maintain Kafka security features including SSL/TLS, SASL, and ACL configurations.
• Automate Kafka cluster operations using Ansible and CI/CD pipelines (Jenkins, GitLab).
• Monitor performance with Prometheus, Grafana, Splunk, and Confluent Control Center (C3).
• Plan cluster upgrades, patch management, and zero-downtime migrations.
• Provide 24/7 production support and collaborate with Confluent Support to resolve incidents.
• Support integration of producer/consumer applications and ensure proper consumer rebalancing.
• Manage schema registry, Kafka log files, and Zookeeper configurations.
• Coordinate with DevOps and cloud teams for Docker/Kubernetes and cloud provisioning (AWS, Azure, GCP).
• Manage AWS services such as MSK, EC2, IAM, S3, CloudWatch, RDS, EKS, and Opensearch.

Skills

Confluent Kafka

Kafka Administration

Kafka Connect

AWS Cloud

DevOps

Python

Bash

SQL

Linux

Communication

Education

Bachelor's Degree in Computer Science or BE

Tools

Jenkins

GitLab

Ansible

Docker

Kubernetes

Prometheus

Grafana

Splunk

Confluent Control Center

Job description

Job Title: Kafka Administrator / Confluent Kafka Engineer Job Type: Full-time Experience: 6+ Years

About the Role: We are looking for a skilled and proactive Confluent Kafka Administrator / Engineer with over 6 years of experience managing and supporting distributed streaming platforms.

The ideal candidate will have hands-on experience in administering Kafka clusters, implementing security and automation practices, and ensuring seamless data integration across cloud-native environments.

You will be responsible for maintaining high availability and performance of our Kafka infrastructure, managing Kafka Connectors, integrating with AWS and DevOps tools, and providing production support.

Key Responsibilities

• Design, deploy, and administer multi-node Confluent Kafka clusters ensuring high availability and fault tolerance.


• Manage Kafka Connect (Source & Sink) for efficient data streaming across systems.


• Implement and maintain Kafka security features including SSL/TLS, SASL, and ACL configurations.


• Automate Kafka cluster operations and topic/user provisioning using Ansible and CI/CD pipelines (Jenkins, GitLab).


• Monitor and optimize Kafka performance using Prometheus, Grafana, Splunk, and Confluent Control Center (C3).


• Plan and execute cluster upgrades, patch management, and zero-downtime migrations.


• Provide 24/7 production support, troubleshoot issues, and collaborate with Confluent Support to resolve incidents.


• Support the integration of producer/consumer applications and ensure proper consumer rebalancing.


• Manage schema registry, Kafka log files, and Zookeeper cluster configurations.


• Work closely with DevOps and cloud teams for container orchestration (Docker, Kubernetes) and cloud provisioning (AWS, Azure, GCP).


• Manage AWS services such as MSK, EC2, IAM, S3, CloudWatch, RDS, EKS, and Opensearch.

Required Skills & Experience

• 5+ years of hands-on experience in Confluent Kafka administration and support.


• Strong expertise in Kafka Connect, Zookeeper, Schema Registry, Kafka Streams, and KSQL.


• Proficient with AWS Cloud Services including MSK, EC2, IAM, S3, CloudWatch, and EKS.


• Working knowledge of Linux-based environments (Amazon Linux, Red Hat).


• Experience with DevOps tools: Jenkins, GitLab, Ansible, Docker, and Kubernetes.


• Solid scripting knowledge in Python, Bash/Shell scripting, and familiarity with SQL.


• Exposure to CI/CD pipelines and automation of Kafka-related tasks.


• Strong analytical and troubleshooting skills with a focus on performance and reliability.


• Excellent communication skills and experience working with support teams and cross-functional stakeholders.

Preferred Qualifications

• Experience working with Confluent Support for enterprise Kafka issues.


• Knowledge of MongoDB, MySQL, Oracle, and data integration practices.


• Familiarity with Azure or GCP cloud platforms.

Education

• Bachelors Degree in Computer Science or related field o BE – Computer Science, Mumbai University (CGPA: 8.16)