Remote Kafka Real-Time Data Engineer

INDI Staffing Services; Colombia; Presencial; COP 90.000.000 - 180.000.000; Jornada completa

Descripción de la vacante

INDI is seeking a Kafka Engineer to design, implement, and maintain robust, scalable event streaming architectures using Apache Kafka to enable real-time data processing across complex enterprise systems.

The role involves building and optimizing data pipelines, configuring Kafka clusters for high availability, and implementing stream processing with Kafka Streams or Apache Flink. You will collaborate with cross-functional teams to integrate solutions and ensure reliability.

Formación

• 3+ years of hands-on experience with distributed streaming architectures.
• Experience with Kafka ecosystem tools such as Confluent Platform, Kafka Connect, and Schema Registry.
• Proficient in Java and stream processing technologies.
• Advanced English proficiency.

Responsabilidades

• Designing and implementing scalable event streaming architectures using Apache Kafka and related technologies.
• Developing and optimizing data pipelines for high-performance, real-time data processing.
• Configuring and managing Kafka clusters, ensuring high availability, fault tolerance, and optimal performance.
• Implementing stream processing solutions using Kafka Streams, Apache Flink, or similar technologies.
• Collaborating with development teams to integrate solutions into existing enterprise architectures.
• Troubleshooting and resolving complex distributed streaming system challenges.

Conocimientos

Apache Kafka

Streaming Architectures

Java

Kafka Ecosystem

Distributed Systems

English

Herramientas

Confluent Platform

Kafka Connect

Schema Registry

Kafka Streams

Apache Flink

Descripción del empleo

INDI is seeking a Kafka Engineer to design, implement, and maintain robust, scalable event streaming architectures using Apache Kafka to enable real-time data processing across complex enterprise systems.

The role involves building and optimizing data pipelines, configuring Kafka clusters for high availability, and implementing stream processing with Kafka Streams or Apache Flink. You will collaborate with cross-functional teams to integrate solutions and ensure reliability.