Senior Kafka Platform Engineer - AWS & Kubernetes

XPT Software; Sydney; On-site; AUD 180,000 - 240,000; Full time

Job summary

XPT Software is seeking a Senior Kafka Administrator/Developer to architect, build and operate enterprise Kafka and event-streaming platforms across AWS and Kubernetes. You will work with cross-functional teams to deliver reliable event-driven solutions, automate tasks and support platform lifecycle and governance.

The role emphasizes hands-on Kafka administration, integration development and production support, with leadership responsibilities for platform modernization and best-practice

Qualifications

• Hands-on Kafka administration in large enterprise environments.
• Experience with Kafka Connect and Schema Registry.
• Experience with Kubernetes / AWS (EKS) and CI/CD tooling.
• Security, TLS, authentication, authorization and secrets management.
• Governance and platform lifecycle support.

Responsibilities

• Administer and support Kafka platforms, including brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and related services.
• Design and develop Kafka producers, consumers, stream-processing components and reusable integration patterns.
• Deploy, operate and improve Kafka and supporting components on Kubernetes and Amazon EKS using Helm, CI/CD, GitOps and approved cloud-native patterns.
• Manage platform reliability, resilience, capacity, performance, patching, upgrades, backup, recovery and lifecycle activities across production and non-production environments.
• Troubleshoot complex issues across applications, brokers, connectors, schemas, networking, storage, certificates and cloud infrastructure.
• Implement monitoring, alerting and dashboards for broker health, throughput, latency, replication, disk usage, consumer lag and connector health.
• Apply security and governance controls, including TLS, authentication, authorisation, ACLs, secrets, certificates, least-privilege access and vulnerability remediation.
• Support incidents, problems, changes and releases, including root-cause analysis, runbook improvement and automation of recurring operational tasks.
• Guide application teams on topic design, partitioning, message contracts, schema evolution, retries, dead-letter handling, idempotency and supportability.
• Maintain architecture, configuration, operational, recovery and support documentation.

Skills

Kafka administration

Kubernetes / EKS

Java / Spring Boot

Python

CI/CD / GitOps

Security & TLS

Observability

Networking

Education

Bachelor's degree in IT/CS/Engineering

Tools

Docker

Helm

Terraform

CloudFormation

Jenkins

Argo CD

CloudWatch

Job description

XPT Software is seeking a Senior Kafka Administrator/Developer to architect, build and operate enterprise Kafka and event-streaming platforms across AWS and Kubernetes. You will work with cross-functional teams to deliver reliable event-driven solutions, automate tasks and support platform lifecycle and governance.

The role emphasizes hands-on Kafka administration, integration development and production support, with leadership responsibilities for platform modernization and best-practice