Senior Kafka Platform Engineer (Cloud & On-Prem)

Cloud Analytics Technologies, LLC; Atlanta (GA); On-site; USD 120,000 - 160,000; Full time

Job summary

Cloud Analytics Technologies, LLC is seeking a senior Kafka Engineer to install, configure, and manage Kafka clusters across on‑prem and cloud environments. You will monitor health, manage topics and retention, and ensure security with TLS, Kerberos, and RBAC.

Collaboration with architects and developers will drive real-time data use cases. Responsibilities include automating tasks, supporting upgrades and DR planning, and maintaining observability with Prometheus, Grafana, and Confluent Control

Qualifications

• Bachelor's or Master's degree in computer science, engineering, or related field.
• 10+ years of software engineering experience.
• 3-5 years of Kafka administration in enterprise environments.
• Strong understanding of Kafka internals, Zookeeper, and Kafka Connect.
• Experience with Kafka in cloud-native environments (AWS MSK, Confluent Cloud, or Kubernetes).
• Proficiency in Linux, shell scripting, and monitoring/logging tools.
• Familiarity with CI/CD pipelines and DevOps practices.

Responsibilities

• Install, configure, and manage Kafka clusters (on-prem/cloud).
• Monitor cluster health, performance, and resource utilization.
• Manage Kafka topics, partitions, replication, and retention policies.
• Monitor Kafka performance, availability, and capacity using Prometheus, Grafana, and Confluent Control Center.
• Implement security controls (authentication, authorization, encryption).
• Implement security best practices including TLS, Kerberos, and RBAC.
• Troubleshoot and resolve issues related to Kafka brokers, producers, and consumers.
• Collaborate with platform architects and developers to support real-time data use cases.
• Automate operational tasks using scripting and infrastructure-as-code tools
• Support upgrades, patching, and disaster recovery planning.

Skills

Kafka administration

Kafka internals

Cloud-native Kafka

Linux & shell scripting

CI/CD & DevOps

Zookeeper

Monitoring & logging

Education

Bachelor's or Master in CS/Engineering

Tools

Prometheus

Grafana

Confluent Control Center

Kubernetes

Zookeeper

Job description

Cloud Analytics Technologies, LLC is seeking a senior Kafka Engineer to install, configure, and manage Kafka clusters across on‑prem and cloud environments. You will monitor health, manage topics and retention, and ensure security with TLS, Kerberos, and RBAC.

Collaboration with architects and developers will drive real-time data use cases. Responsibilities include automating tasks, supporting upgrades and DR planning, and maintaining observability with Prometheus, Grafana, and Confluent Control