Kafka Engineer - Remote Work

INDI Staffing Services; Rio de Janeiro; Hybrid; BRL 180,000 - 260,000; Full time

Benefits offered by this job

Tailored compensation

Tech-driven tools

Autonomous workflow

Generous leave

Diversity & inclusion

Mentorship & growth

Job summary

INDI is seeking a Kafka Engineer to design, implement, and maintain robust streaming architectures using Apache Kafka to enable real-time data processing across enterprise systems.

You will build scalable pipelines, manage Kafka clusters for high availability, and collaborate with engineering teams to integrate streaming solutions within existing architectures. Strong Java skills and deep knowledge of Kafka ecosystem are essential, with flexible work options.

Qualifications

• 3+ years hands-on experience with distributed streaming architectures.
• Proficient in Java and stream processing.
• Experience with Kafka ecosystem tools.
• Strong English communication.

Responsibilities

• Design scalable event streaming architectures with Kafka.
• Develop and optimize real-time data pipelines.
• Manage Kafka clusters for availability and performance.
• Implement stream processing with Kafka Streams or Flink.
• Collaborate with teams to integrate solutions.
• Troubleshoot distributed streaming challenges.

Skills

English proficiency

Distributed systems

Analytical thinking

Tools

Apache Kafka

Confluent Platform

Kafka Connect

Schema Registry

Kafka Streams

Apache Flink

Java

Job description

At INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.

Overview of the role

The Kafka Engineer will be responsible for designing, implementing, and maintaining robust, scalable event streaming architectures using Apache Kafka. This role plays a critical part in developing distributed streaming solutions that enable real-time data processing and integration across complex enterprise systems.

Key responsibilities

• Designing and implementing scalable event streaming architectures using Apache Kafka and related technologies.
• Developing and optimizing data pipelines for high-performance, real-time data processing.
• Configuring and managing Kafka clusters, ensuring high availability, fault tolerance, and optimal performance.
• Implementing stream processing solutions using Kafka Streams, Apache Flink, or similar technologies.
• Collaborating with development teams to integrate solutions into existing enterprise architectures.
• Troubleshooting and resolving complex distributed streaming system challenges.

Requirements

• Apache Kafka: 3+ years of hands-on experience with distributed streaming architectures.
• Streaming Solutions: Strong expertise designing and implementing event streaming systems.
• Java: Proficiency in the language and stream processing technologies.
• Kafka Ecosystem: Experience with tools such as Confluent Platform, Kafka Connect, and Schema Registry.
• Distributed Systems: Deep understanding of messaging architectures.
• Language Proficiency: Advanced level of English.
• Flexibility: Choose where and how you work for enhanced creativity and innovation.
• Tailored Compensation: Personalize your earnings to suit your financial goals.
• Tech-Driven Tools: Access cutting-edge resources for seamless collaboration and productivity.
• Autonomous Workflow: Take control of your schedule to achieve work-life balance.
• Well-being: Enjoy generous leave policies for rest and rejuvenation.
• Diversity & Inclusion: Thrive in a diverse and inclusive environment.
• Collaboration: Engage with industry leaders for collective growth.
• Development: Access mentorship and growth opportunities for continuous advancement.