Senior Kafka Platform Engineer – AWS EKS & Kubernetes

Ayan Infotech; Sydney; On-site; AUD 140,000 - 180,000; Full time

Job summary

AYAN InfoTech in Sydney is seeking a Kafka Administrator/Developer to design, build, operate and improve enterprise Kafka platforms across AWS and Kubernetes (EKS). The role requires strong hands-on Kafka administration, integration development, cloud-native operations and production support experience.

The role works with application, integration, cloud, security and operations teams to deliver reliable event-driven solutions, automate repetitive tasks and support platform lifecycle, governance

Qualifications

• Experience administering Apache Kafka or Confluent Platform in enterprise environments.
• Solid understanding of Kafka brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and MirrorMaker.
• Experience developing Kafka producers, consumers and integration services using Java, Spring Boot, Python or equivalent technologies.

Responsibilities

• Administer and support Kafka platforms, including brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and related services.
• Design and develop Kafka producers, consumers, stream-processing components and reusable integration patterns using Java, Spring Boot, Python or similar technologies.
• Deploy, operate and improve Kafka and supporting components on Kubernetes and Amazon EKS using Helm, CI/CD, GitOps and approved cloud-native patterns.
• Manage platform reliability, resilience, capacity, performance, patching, upgrades, backup, recovery and lifecycle activities across production and non-production environments.
• Troubleshoot complex issues across applications, brokers, connectors, schemas, networking, storage, certificates and cloud infrastructure.
• Implement monitoring, alerting and dashboards for broker health, throughput, latency, replication, disk usage, consumer lag and connector health.
• Apply security and governance controls, including TLS, authentication, authorisation, ACLs, secrets, certificates, least-privilege access and vulnerability remediation.
• Support incidents, problems, changes and releases, including root-cause analysis, runbook improvement and automation of recurring operational tasks.
• Guide application teams on topic design, partitioning, message contracts, schema evolution, retries, dead-letter handling, idempotency and supportability.
• Maintain architecture, configuration, operational, recovery and support documentation.

Skills

Kafka administration

Kubernetes

AWS (EKS)

Java

Spring Boot

Python

CI/CD

Networking

Observability

Tools

Docker

Helm

GitOps

Terraform

CloudFormation

Jenkins

Argo CD

Job description

AYAN InfoTech in Sydney is seeking a Kafka Administrator/Developer to design, build, operate and improve enterprise Kafka platforms across AWS and Kubernetes (EKS). The role requires strong hands-on Kafka administration, integration development, cloud-native operations and production support experience.

The role works with application, integration, cloud, security and operations teams to deliver reliable event-driven solutions, automate repetitive tasks and support platform lifecycle, governance