Senior Kafka Architect - Cloud-Native Data Streams (Sydney)

CareCone Group; Sydney; On-site; AUD 120,000 - 180,000; Part time

Job summary

CareCone Group seeks a Senior Kafka Administrator/Developer to design, build, operate and improve enterprise Kafka platforms on AWS and Kubernetes. The role focuses on hands-on Kafka administration, integration development, and production support.

Expect expertise in Kafka components, Java/Python, and cloud-native tooling to ensure scalable, secure streaming pipelines and observability across platforms.

Qualifications

• Extensive hands-on Kafka administration in large enterprise environments.
• Deep knowledge of Kafka brokers, topics, partitions, replication, consumer groups, Kafka Connect, and Schema Registry.
• Experience building integration services with Java, Spring Boot or Python and deploying on Kubernetes/AWS.

Responsibilities

• Administer and support Kafka platforms (brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry).
• Design and develop Kafka producers/consumers and streaming components using Java, Spring Boot, Python.
• Deploy and operate Kafka on Kubernetes and Amazon EKS using Helm, CI/CD, and GitOps patterns.
• Manage platform reliability, capacity, performance, patching, upgrades, backup and recovery across environments.
• Troubleshoot complex issues across apps, brokers, connectors, schemas, networking and cloud infra.
• Implement monitoring, alerting and dashboards for broker health, throughput and latency.

Skills

Kafka administration

Confluent Platform

Kafka Connect

Schema Registry

MirrorMaker

Java Spring Boot

Python

Kubernetes

Amazon EKS

Docker

Helm

AWS services

CI/CD

GitOps

Jenkins

Argo CD

Terraform

CloudFormation

Linux networking

Observability tools

Tools

Kubernetes

Docker

Helm

Jenkins

Argo CD

Terraform

CloudFormation

Prometheus

Grafana

Splunk

Job description

CareCone Group seeks a Senior Kafka Administrator/Developer to design, build, operate and improve enterprise Kafka platforms on AWS and Kubernetes. The role focuses on hands-on Kafka administration, integration development, and production support.

Expect expertise in Kafka components, Java/Python, and cloud-native tooling to ensure scalable, secure streaming pipelines and observability across platforms.