Kafka Admin

Cloud Analytics Technologies, LLC; Atlanta (GA); Vor Ort; USD 120.000 - 160.000; Vollzeit

Zusammenfassung

Cloud Analytics Technologies, LLC is seeking a senior Kafka Engineer to install, configure, and manage Kafka clusters across on‑prem and cloud environments. You will monitor health, manage topics and retention, and ensure security with TLS, Kerberos, and RBAC.

Collaboration with architects and developers will drive real-time data use cases. Responsibilities include automating tasks, supporting upgrades and DR planning, and maintaining observability with Prometheus, Grafana, and Confluent Control

Qualifikationen

• Bachelor's or Master's degree in computer science, engineering, or related field.
• 10+ years of software engineering experience.
• 3-5 years of Kafka administration in enterprise environments.
• Strong understanding of Kafka internals, Zookeeper, and Kafka Connect.
• Experience with Kafka in cloud-native environments (AWS MSK, Confluent Cloud, or Kubernetes).
• Proficiency in Linux, shell scripting, and monitoring/logging tools.
• Familiarity with CI/CD pipelines and DevOps practices.

Aufgaben

• Install, configure, and manage Kafka clusters (on-prem/cloud).
• Monitor cluster health, performance, and resource utilization.
• Manage Kafka topics, partitions, replication, and retention policies.
• Monitor Kafka performance, availability, and capacity using Prometheus, Grafana, and Confluent Control Center.
• Implement security controls (authentication, authorization, encryption).
• Implement security best practices including TLS, Kerberos, and RBAC.
• Troubleshoot and resolve issues related to Kafka brokers, producers, and consumers.
• Collaborate with platform architects and developers to support real-time data use cases.
• Automate operational tasks using scripting and infrastructure-as-code tools
• Support upgrades, patching, and disaster recovery planning.

Kenntnisse

Kafka administration

Kafka internals

Cloud-native Kafka

Linux & shell scripting

CI/CD & DevOps

Zookeeper

Monitoring & logging

Ausbildung

Bachelor's or Master in CS/Engineering

Tools

Prometheus

Grafana

Confluent Control Center

Kubernetes

Zookeeper

Jobbeschreibung

• Install, configure, and manage Kafka clusters (on-prem/cloud).


• Monitor cluster health, performance, and resource utilization.


• Manage Kafka topics, partitions, replication, and retention policies.


• Monitor Kafka performance, availability, and capacity using tools like Prometheus, Grafana, and Confluent Control Center.


• Implement security controls (authentication, authorization, encryption).


• Implement security best practices including TLS, Kerberos, and RBAC.


• Troubleshoot and resolve issues related to Kafka brokers, producers, and consumers.


• Collaborate with platform architects and developers to support real-time data use cases.


• Automate operational tasks using scripting and infrastructure-as-code tools


• Support upgrades, patching, and disaster recovery planning

Required Qualifications:

• Bachelor’s or master’s degree in computer science, Engineering, or related field.


• Minimum 10+ years of experience in software engineering,


• 3-5 years of experience in Kafka administration in enterprise environments.


• Strong understanding of Kafka internals, Zookeeper, and Kafka Connect.


• Experience with Kafka in cloud-native environments (AWS MSK, Confluent Cloud, or self-managed on Kubernetes).


• Proficiency in Linux, shell scripting, and monitoring/logging tools.


• Familiarity withCI/CD pipelines and DevOps practices.

CLOUD ANALYTICS TECHNOLOGIES is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. CLOUD ANALYTICS TECHNOLOGIES will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will CLOUD ANALYTICS TECHNOLOGIES require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract

Equal Opportunity Employer

CLOUD ANALYTICS TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. CLOUD ANALYTICS TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will CLOUD ANALYTICS TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract

Some of our Business Ventures - Knowledge Analytics

Do restrictive necessities, your capability for advanced analytics or your business model need custom-made applications and infrastructure configurations? opt for our hosted managed services to urge comprehensive analytics solutions supported industry-leading Cloud Analytics Technologies, LLC code - delivered by the Cloud Analytics Technologies, LLC consultants UN agency understand these solutions best. Through a mix of with-it technology and dedicated service and support, Cloud Analytics Technologies, LLC hosted managed services will facilitate you: