Kafka Administrator / Developer (Kafka & AWS EKS) - Sydney

Ayan Infotech; Sydney; On-site; AUD 140,000 - 180,000; Full time

Job summary

AYAN InfoTech in Sydney is seeking a Kafka Administrator/Developer to design, build, operate and improve enterprise Kafka platforms across AWS and Kubernetes (EKS). The role requires strong hands-on Kafka administration, integration development, cloud-native operations and production support experience.

The role works with application, integration, cloud, security and operations teams to deliver reliable event-driven solutions, automate repetitive tasks and support platform lifecycle, governance

Qualifications

• Experience administering Apache Kafka or Confluent Platform in enterprise environments.
• Solid understanding of Kafka brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and MirrorMaker.
• Experience developing Kafka producers, consumers and integration services using Java, Spring Boot, Python or equivalent technologies.

Responsibilities

• Administer and support Kafka platforms, including brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and related services.
• Design and develop Kafka producers, consumers, stream-processing components and reusable integration patterns using Java, Spring Boot, Python or similar technologies.
• Deploy, operate and improve Kafka and supporting components on Kubernetes and Amazon EKS using Helm, CI/CD, GitOps and approved cloud-native patterns.
• Manage platform reliability, resilience, capacity, performance, patching, upgrades, backup, recovery and lifecycle activities across production and non-production environments.
• Troubleshoot complex issues across applications, brokers, connectors, schemas, networking, storage, certificates and cloud infrastructure.
• Implement monitoring, alerting and dashboards for broker health, throughput, latency, replication, disk usage, consumer lag and connector health.
• Apply security and governance controls, including TLS, authentication, authorisation, ACLs, secrets, certificates, least-privilege access and vulnerability remediation.
• Support incidents, problems, changes and releases, including root-cause analysis, runbook improvement and automation of recurring operational tasks.
• Guide application teams on topic design, partitioning, message contracts, schema evolution, retries, dead-letter handling, idempotency and supportability.
• Maintain architecture, configuration, operational, recovery and support documentation.

Skills

Kafka administration

Kubernetes

AWS (EKS)

Java

Spring Boot

Python

CI/CD

Networking

Observability

Tools

Docker

Helm

GitOps

Terraform

CloudFormation

Jenkins

Argo CD

Job description

AYAN InfoTech is looking for Kafka Administrator / Developer (Kafka & AWS EKS) to join an exciting project based in Sydney. The role offers you the opportunity to contribute towards an extremely well structured and mature environment, working on sophisticated enhancement projects.

Role Details

Role: Kafka Administrator / Developer (Kafka & AWS EKS) Location: Sydney Contract Duration: 6+ Months with high possible extensions Experience: 7+ Years

Job Summary:

The Kafka Administrator / Developer will design, build, operate and improve enterprise Kafka and event-streaming platforms across AWS and Kubernetes, including Amazon EKS. The role requires strong hands-on Kafka administration, integration development, cloud-native operations and production support experience.

The role works closely with application, integration, cloud, security and operations teams to deliver reliable event-driven solutions, resolve complex issues, automate repeatable tasks and support platform lifecycle, governance and service improvement activities.

Key Responsibilities

• Administer and support Kafka platforms, including brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and related services.
• Design and develop Kafka producers, consumers, stream-processing components and reusable integration patterns using Java, Spring Boot, Python or similar technologies.
• Deploy, operate and improve Kafka and supporting components on Kubernetes and Amazon EKS using Helm, CI/CD, GitOps and approved cloud-native patterns.
• Manage platform reliability, resilience, capacity, performance, patching, upgrades, backup, recovery and lifecycle activities across production and non-production environments.
• Troubleshoot complex issues across applications, brokers, connectors, schemas, networking, storage, certificates and cloud infrastructure.
• Implement monitoring, alerting and dashboards for broker health, throughput, latency, replication, disk usage, consumer lag and connector health.
• Apply security and governance controls, including TLS, authentication, authorisation, ACLs, secrets, certificates, least-privilege access and vulnerability remediation.
• Support incidents, problems, changes and releases, including root-cause analysis, runbook improvement and automation of recurring operational tasks.
• Guide application teams on topic design, partitioning, message contracts, schema evolution, retries, dead-letter handling, idempotency and supportability.
• Maintain architecture, configuration, operational, recovery and support documentation.

Key Skills & Experience

• Strong hands-on experience administering Apache Kafka or Confluent Platform in complex enterprise environments.
• Solid understanding of Kafka brokers, topics, partitions, replication, consumer groups, Kafka Connect, Schema Registry and MirrorMaker.
• Experience developing Kafka producers, consumers and integration services using Java, Spring Boot, Python or equivalent technologies.
• Hands-on experience with Kubernetes and Amazon EKS, including Docker, Helm, storage, networking, ingress, secrets and identity integration.
• Working knowledge of AWS services such as EKS, EC2, S3, IAM, CloudWatch, Route 53 and core networking services.
• Experience with CI/CD, GitOps and Infrastructure as Code tools such as Jenkins, Argo CD, Terraform or CloudFormation.
• Strong Linux, networking, TLS, DNS, certificate and distributed-systems troubleshooting capability.
• Experience with observability tools such as Prometheus, Grafana, CloudWatch, Dynatrace, Splunk or equivalent.

Contact

61-[phone] for more details.

Please note we will be able to contact only shortlisted candidates for this role. We thank you in advance for your interest.