Kafka Developer

CareCone Group; Sydney; On-site; AUD 120,000 - 180,000; Part time

Job summary

CareCone Group seeks a Senior Kafka Administrator/Developer to design, build, operate and improve enterprise Kafka platforms on AWS and Kubernetes. The role focuses on hands-on Kafka administration, integration development, and production support.

Expect expertise in Kafka components, Java/Python, and cloud-native tooling to ensure scalable, secure streaming pipelines and observability across platforms.

Qualifications

• Extensive hands-on Kafka administration in large enterprise environments.
• Deep knowledge of Kafka brokers, topics, partitions, replication, consumer groups, Kafka Connect, and Schema Registry.
• Experience building integration services with Java, Spring Boot or Python and deploying on Kubernetes/AWS.

Responsibilities

• Administer and support Kafka platforms (brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry).
• Design and develop Kafka producers/consumers and streaming components using Java, Spring Boot, Python.
• Deploy and operate Kafka on Kubernetes and Amazon EKS using Helm, CI/CD, and GitOps patterns.
• Manage platform reliability, capacity, performance, patching, upgrades, backup and recovery across environments.
• Troubleshoot complex issues across apps, brokers, connectors, schemas, networking and cloud infra.
• Implement monitoring, alerting and dashboards for broker health, throughput and latency.

Skills

Kafka administration

Confluent Platform

Kafka Connect

Schema Registry

MirrorMaker

Java Spring Boot

Python

Kubernetes

Amazon EKS

Docker

Helm

AWS services

CI/CD

GitOps

Jenkins

Argo CD

Terraform

CloudFormation

Linux networking

Observability tools

Tools

Kubernetes

Docker

Helm

Jenkins

Argo CD

Terraform

CloudFormation

Prometheus

Grafana

Splunk

Job description

Job Type- Contract

Location- Sydney

JD-

Role Summary

The Senior Kafka Administrator / Developer will design, build, operate and improve enterprise Kafka and event-streaming platforms across AWS and Kubernetes, including Amazon EKS. The role requires strong hands‑on Kafka administration, integration development, cloud‑native operations and production support experience.

Key Skills & Experience

Technical Experience

• Strong hands‑on experience administering Apache Kafka or Confluent Platform in complex enterprise environments.
• Solid understanding of Kafka brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and MirrorMaker.
• Experience developing Kafka producers, consumers and integration services using Java, Spring Boot, Python or equivalent technologies.
• Hands‑on experience with Kubernetes and Amazon EKS, including Docker, Helm, storage, networking, ingress, secrets and identity integration.
• Working knowledge of AWS services such as EKS, EC2, S3, IAM, CloudWatch, Route 53 and core networking services.
• Experience with CI/CD, GitOps and Infrastructure as Code tools such as Jenkins, Argo CD, Terraform or CloudFormation.
• Strong Linux, networking, TLS, DNS, certificate and distributed‑systems troubleshooting capability.
• Experience with observability tools such as Prometheus, Grafana, CloudWatch, Dynatrace, Splunk or equivalent.

Key Responsibilities

• Administer and support Kafka platforms, including brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and related services.
• Design and develop Kafka producers, consumers, stream‑processing components and reusable integration patterns using Java, Spring Boot, Python or similar technologies.
• Deploy, operate and improve Kafka and supporting components on Kubernetes and Amazon EKS using Helm, CI/CD, GitOps and approved cloud‑native patterns.
• Manage platform reliability, resilience, capacity, performance, patching, upgrades, backup, recovery and lifecycle activities across production and non‑production environments.
• Troubleshoot complex issues across applications, brokers, connectors, schemas, networking, storage, certificates and cloud infrastructure.
• Implement monitoring, alerting and dashboards for broker health, throughput, latency, replication, disk usage, consumer lag and connector health.
• Apply security and governance controls, including TLS, authentication, authorisation, ACLs, secrets, certificates, least‑privilege access and vulnerability remediation.
• Support incidents, problems, changes and releases, including root‑cause analysis, runbook improvement and automation of recurring operational tasks.
• Guide application teams on topic design, partitioning, message contracts, schema evolution, retries, dead‑letter handling, idempotency and supportability.
• Maintain architecture, configuration, operational, recovery and support documentation.