Principal Kafka Engineer & Automation Lead

Golden Technology, Inc.; Blue Ash (OH); On-site; USD 140,000 - 180,000; Full time

Job summary

Golden Technology, Inc. is seeking a Principal Kafka Engineer to lead the management, scaling, and optimization of our enterprise event-streaming ecosystem. The ideal candidate brings deep expertise in Apache/Confluent Kafka and applies object-oriented programming to advanced automation.

Strong experience with ITSM, DevOps, CI/CD, and cloud hybrid environments is required. You will collaborate with distributed teams to ensure highly available, low-latency production systems.

Qualifications

• 3–5+ years of Kafka administration experience.
• 10+ years in software development or systems engineering.
• Expertise in Apache Kafka or Confluent Platform, including Schema Registry, Kafka Connect, Avro, and KSQL.
• Proficient in Cluster Management - Zookeeper, KRaft.
• Strong object-oriented programming skills; Java, Go, Python.
• Hands-on experience with Infrastructure as Code tools such as Terraform, Ansible, or Salt.
• Java backend development experience with Spring Boot.
• Solid understanding of software design patterns.
• Ability to create and maintain architecture artifacts.
• Proficient in containerization technology such as Docker, Kubernetes.
• Expertise in DevOps, CI/CD, and GitHub Actions.
• Expertise in Domain Driven Design and Enterprise Application Integration.
• Experience with observability, telemetry, and APM tools such as dynaTrace.
• Good understanding of networking, storage, virtualization, and other infrastructure architecture.
• Self-starter with a goal-oriented mindset.
• Excellent communication, negotiation, and problem-solving skills.
• Expertise in supporting a Highly Available Low Latent Enterprise Application in Production environment(s).
• Experience working with globally distributed team(s).
• Frameworks: ITSM/ITIL frameworks and Agile methodologies.

Responsibilities

• Kafka Administration: Deploy, configure, and maintain highly available Kafka clusters across on-premises and cloud environments, including Azure and GCP.
• OOP-Based Development and Automation: Design and build reusable frameworks, automation tools, and APIs using Java to simplify cluster provisioning, monitoring, and self-service onboarding.
• ITSM Integration: Manage the platform lifecycle through ITSM processes, including incident, problem, and change management, to reduce downtime and maintain SLA compliance.
• Security and Compliance: Implement and maintain security controls and authentication mechanisms.
• Performance Optimization: Monitor cluster health with tools such as dynaTrace, Prometheus, and Grafana. Perform capacity planning and tuning to support high-throughput data pipelines.
• Collaboration: Partner with DevOps and application teams to provide guidance on event-driven architecture and producer/consumer performance best practices.

Skills

Kafka

Confluent Platform

Java

Go

Python

OO Programming

Spring Boot

Domain Driven Design

Enterprise App Integration

Observability/APM

Networking/Storage/Virtualization

Architecture & Design

ITSM/ITIL

Agile methodologies

Distributed teams

CI/CD/GitHub Actions

Tools

Zookeeper

KRaft

Terraform

Ansible

Salt

Docker

Kubernetes

dynaTrace

Prometheus

Grafana

Kafka Connect

Schema Registry

Avro

GitHub Actions

Job description

Golden Technology, Inc. is seeking a Principal Kafka Engineer to lead the management, scaling, and optimization of our enterprise event-streaming ecosystem. The ideal candidate brings deep expertise in Apache/Confluent Kafka and applies object-oriented programming to advanced automation.

Strong experience with ITSM, DevOps, CI/CD, and cloud hybrid environments is required. You will collaborate with distributed teams to ensure highly available, low-latency production systems.