Kafka Engineer - Remote Work

INDI Staffing Services; Belo Horizonte; Hybrid; BRL 180,000 - 240,000; Full time

Benefits offered by this job

Flexible work arrangements

Personalized compensation

Autonomous schedule

Generous leave

Job summary

INDI Staffing Services seeks a Kafka Engineer to design, implement, and maintain scalable event streaming architectures using Apache Kafka. You will build real-time data pipelines and ensure reliable data flows across enterprise systems.

You will collaborate with cross-functional teams, optimize streaming pipelines, and implement stream processing with Kafka Streams or Flink. Strong Java skills and English proficiency are required, with flexible work arrangements.

Qualifications

• 3+ years hands-on experience with distributed streaming architectures using Apache Kafka.
• Strong expertise designing and implementing event streaming systems.
• Proficiency in Java and stream processing technologies.
• Experience with Confluent Platform, Kafka Connect, and Schema Registry.
• Advanced English language proficiency.

Responsibilities

• Design and implement scalable event streaming architectures with Apache Kafka.
• Develop and optimize data pipelines for real-time data processing.
• Configure and manage Kafka clusters ensuring high availability and optimal performance.
• Implement stream processing using Kafka Streams, Flink, or similar technologies.
• Collaborate with development teams to integrate solutions into enterprise architectures.
• Troubleshoot and resolve complex distributed streaming system challenges.

Skills

Distributed Systems

Real-time data processing

Java programming

English proficiency

Tools

Apache Kafka

Confluent Platform

Kafka Connect

Schema Registry

Kafka Streams

Apache Flink

Java

Job description

At INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.

Overview of the role

The Kafka Engineer will be responsible for designing, implementing, and maintaining robust, scalable event streaming architectures using Apache Kafka. This role plays a critical part in developing distributed streaming solutions that enable real-time data processing and integration across complex enterprise systems.

Key responsibilities

• Designing and implementing scalable event streaming architectures using Apache Kafka and related technologies.
• Developing and optimizing data pipelines for high-performance, real-time data processing.
• Configuring and managing Kafka clusters, ensuring high availability, fault tolerance, and optimal performance.
• Implementing stream processing solutions using Kafka Streams, Apache Flink, or similar technologies.
• Collaborating with development teams to integrate solutions into existing enterprise architectures.
• Troubleshooting and resolving complex distributed streaming system challenges.

Requirements

• Apache Kafka: 3+ years of hands-on experience with distributed streaming architectures.
• Streaming Solutions: Strong expertise designing and implementing event streaming systems.
• Java: Proficiency in the language and stream processing technologies.
• Kafka Ecosystem: Experience with tools such as Confluent Platform, Kafka Connect, and Schema Registry.
• Distributed Systems: Deep understanding of messaging architectures.
• Language Proficiency: Advanced level of English.
• Flexibility: Choose where and how you work for enhanced creativity and innovation.
• Tailored Compensation: Personalize your earnings to suit your financial goals.
• Tech-Driven Tools: Access cutting-edge resources for seamless collaboration and productivity.
• Autonomous Workflow: Take control of your schedule to achieve work-life balance.
• Well-being: Enjoy generous leave policies for rest and rejuvenation.
• Diversity & Inclusion: Thrive in a diverse and inclusive environment.
• Collaboration: Engage with industry leaders for collective growth.
• Development: Access mentorship and growth opportunities for continuous advancement.