Kafka Admin

Cloud Hybrid Technologies LLC; Atlanta (GA); On-site; USD 120,000 - 180,000; Full time

Job summary

Cloud Hybrid Technologies LLC seeks an experienced Senior Kafka/Platform Engineer to install, configure, and manage Kafka clusters both on-prem and in the cloud, while monitoring health and capacity. You will implement robust security controls and collaborate with platform teams to support real-time data use cases.

The role requires extensive software engineering experience, 3–5 years with Kafka administration, cloud-native Kafka experience, Linux proficiency, and strong CI/CD/DevOps skills.

Qualifications

• Bachelor’s or master’s degree in computer science, engineering, or related field.
• Minimum 10+ years of experience in software engineering.
• 3–5 years of experience in Kafka administration in enterprise environments.
• Strong understanding of Kafka internals, Zookeeper, and Kafka Connect.
• Experience with Kafka in cloud-native environments (AWS MSK, Confluent Cloud, or self-managed on Kubernetes).
• Proficiency in Linux, shell scripting, and monitoring/logging tools.
• Familiarity with CI/CD pipelines and DevOps practices.

Responsibilities

• Install, configure, and manage Kafka clusters (on-prem/cloud).
• Monitor cluster health, performance, and resource utilization.
• Manage Kafka topics, partitions, replication, and retention policies.
• Monitor Kafka performance, availability, and capacity using Prometheus, Grafana, and Confluent Control Center.
• Implement security controls (authentication, authorization, encryption).
• Implement security best practices including TLS, Kerberos, and RBAC.
• Troubleshoot and resolve issues related to Kafka brokers, producers, and consumers.
• Collaborate with platform architects and developers to support real-time data use cases.
• Automate operational tasks using scripting and infrastructure-as-code tools
• Support upgrades, patching, and disaster recovery planning

Skills

Collaboration

Problem solving

Cross-functional teamwork

Education

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field

Tools

Kafka administration

Zookeeper

Kafka Connect

AWS MSK

Confluent Cloud

Kubernetes

Linux

Shell scripting

Prometheus

Grafana

Confluent Control Center

CI/CD pipelines

DevOps practices

TLS

Kerberos

RBAC

Job description

• Install, configure, and manage Kafka clusters (on-prem/cloud).


• Monitor cluster health, performance, and resource utilization.


• Manage Kafka topics, partitions, replication, and retention policies.


• Monitor Kafka performance, availability, and capacity using tools like Prometheus, Grafana, and Confluent Control Center.


• Implement security controls (authentication, authorization, encryption).


• Implement security best practices including TLS, Kerberos, and RBAC.


• Troubleshoot and resolve issues related to Kafka brokers, producers, and consumers.


• Collaborate with platform architects and developers to support real-time data use cases.


• Automate operational tasks using scripting and infrastructure-as-code tools


• Support upgrades, patching, and disaster recovery planning

Required Qualifications:

• Bachelor’s or master’s degree in computer science, Engineering, or related field.


• Minimum 10+ years of experience in software engineering,


• 3–5 years of experience in Kafka administration in enterprise environments.


• Strong understanding of Kafka internals, Zookeeper, and Kafka Connect.


• Experience with Kafka in cloud-native environments (AWS MSK, Confluent Cloud, or self-managed on Kubernetes).


• Proficiency in Linux, shell scripting, and monitoring/logging tools.


• Familiarity withCI/CD pipelines and DevOps practices."

Cloud Hybrid is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Hybrid will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Hybrid require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract