Kafka Real-Time Data Integration Engineer

Umbrella Club; Melbourne; On-site; AUD 120,000 - 160,000; Full time

Job summary

Umbrella Club is seeking an experienced Kafka Developer to design and develop real-time data integration solutions using Kafka, Confluent Cloud, and stream processing technologies. The role emphasizes hands-on Java/Spring Boot development for custom integrations, with a focus on real-time data transformation using Flink SQL and robust validation via Schema Registry.

Experience with REST APIs, Kong Gateway, and API integration is required, alongside GitLab CI/CD and testing practices.

Qualifications

• Strong experience with Apache Kafka, Confluent Cloud, and event-driven architecture.

Responsibilities

• Design and develop real-time data integration solutions using Kafka and stream processing technologies.
• Collaborate with teams to build scalable event-driven integrations.
• Ensure quality through testing and troubleshooting of data pipelines.

Skills

Apache Kafka

Confluent Cloud

Event-driven architecture

Java/Spring Boot

Flink SQL

Schema Registry

Kafka producers/consumers

REST APIs

Kong Gateway

HTTP-based integrations

GitLab CI/CD

Integration testing

Troubleshooting

Data engineering

Microservices

Confluent certification

Tools

Kafka

Confluent Cloud

Job description

Umbrella Club is seeking an experienced Kafka Developer to design and develop real-time data integration solutions using Kafka, Confluent Cloud, and stream processing technologies. The role emphasizes hands-on Java/Spring Boot development for custom integrations, with a focus on real-time data transformation using Flink SQL and robust validation via Schema Registry.

Experience with REST APIs, Kong Gateway, and API integration is required, alongside GitLab CI/CD and testing practices.