Senior Kafka Engineer — Lead Enterprise Streaming Platform

Golden Resources Group; Blue Ash (OH); On-site; USD 180,000 - 240,000; Full time

Job summary

Golden Resources Group seeks a Principal Kafka Engineer to lead management, scaling, and optimization of our enterprise event-streaming ecosystem. The ideal candidate brings deep expertise in Apache/Confluent Kafka, applies OO programming to automation, and uses ITSM practices to support reliable, high-quality service delivery.

Responsibilities include deploying and maintaining highly available Kafka clusters across on-prem and cloud; designing reusable automation using Java; integrating ITSM

Qualifications

• 3+ years Kafka administration and 10+ years in software or systems engineering.
• Expertise in Apache Kafka or Confluent Platform incl. Schema Registry, Kafka Connect, Avro, KSQL.
• Proficient in cluster management - Zookeeper, KRaft.
• Strong OO programming: Java, Go, Python.
• Hands-on IaC tools: Terraform, Ansible, Salt.
• Java backend development with Spring Boot.
• Solid understanding of software design patterns.
• Knowledge of architecture artifacts and Enterprise IT systems.
• Proficient in Docker, Kubernetes and related tooling.
• DevOps, CI/CD, and GitHub Actions expertise.
• Domain Driven Design and EAI experience.
• Observability and telemetry with tools like dynaTrace, Prometheus, Grafana.
• Networking, storage, virtualization, and infra concepts.
• Self-starter with problem-solving and communication skills.
• Experience with globally distributed teams.
• ITSM/ITIL frameworks and Agile methodologies.

Responsibilities

• Kafka Administration: Deploy, configure, and maintain highly available Kafka clusters across on-premises and cloud environments (Azure, GCP).
• OOP-Based Development and Automation: Build reusable frameworks, automation tools, and APIs using Java for provisioning and monitoring.
• ITSM Integration: Manage platform lifecycle via ITSM processes to reduce downtime and SLA compliance.
• Security and Compliance: Implement and maintain security controls and authentication mechanisms.
• Performance Optimization: Monitor cluster health with dynaTrace, Prometheus, Grafana; capacity planning and tuning for high-throughput pipelines.
• Collaboration: Partner with DevOps and application teams on event-driven architecture and best practices.

Skills

Kafka administration

Java

Go

Python

Terraform

Ansible

Kubernetes

Docker

CI/CD

ITSM/ITIL

Distributed systems

Tools

Schema Registry

Kafka Connect

Avro

KSQL

Zookeeper

KRaft

Prometheus

Grafana

GitHub Actions

Job description

Golden Resources Group seeks a Principal Kafka Engineer to lead management, scaling, and optimization of our enterprise event-streaming ecosystem. The ideal candidate brings deep expertise in Apache/Confluent Kafka, applies OO programming to automation, and uses ITSM practices to support reliable, high-quality service delivery.

Responsibilities include deploying and maintaining highly available Kafka clusters across on-prem and cloud; designing reusable automation using Java; integrating ITSM