Kafka Integration Specialist

Forward Eye Technologies; Dadri; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Forward Eye Technologies seeks a Kafka Integration Specialist to design, develop, and maintain real-time streaming data pipelines. You will work with Kafka Connect and Kafka Streams to deliver robust integration solutions across distributed systems, ensuring high availability and data integrity.

Ideal candidates have 4+ years of hands-on Kafka experience, proficiency in Java or Python, and familiarity with cloud deployments (AWS/Azure/GCP).

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 4+ years of hands-on experience in Kafka integration projects.
• Experience with designing, developing, and deploying Kafka-based data pipelines.
• Familiarity with Kafka administration: topics, partitions, consumer groups.

Responsibilities

• Design, implement, and maintain Kafka-based data pipelines.
• Develop integration solutions using Kafka Connect, Kafka Streams, and related technologies.
• Manage Kafka clusters for high availability, scalability, and performance.
• Collaborate with cross-functional teams to understand integration requirements.
• Implement best practices for data streaming, including serialization and replication.
• Monitor performance, latency, and security issues in Kafka deployments.
• Ensure data integrity and failover strategies for critical pipelines.

Skills

Kafka Streams

Kafka Connect

Java

Python

Scala

Distributed systems

Data streaming concepts

Education

Bachelor's degree in CS/IT

Tools

Zookeeper

Confluent Kafka

REST APIs

MQ

ESB

AWS

Azure

GCP

Job description

We are seeking a highly skilled Kafka Integration Specialist to join our team. The ideal candidate will have extensive experience in designing, developing, and integrating Apache Kafka solutions to support real-time data streaming and distributed systems.

Key Responsibilities:

• Design, implement, and maintain Kafka-based data pipelines.
• Develop integration solutions using Kafka Connect, Kafka Streams, and other related technologies.
• Manage Kafka clusters, ensuring high availability, scalability, and performance.
• Collaborate with cross-functional teams to understand integration requirements and deliver robust solutions.
• Implement best practices for data streaming, including message serialization, partitioning, and replication.
• Monitor and troubleshoot Kafka performance, latency, and security issues.
• Ensure data integrity and implement failover strategies for critical data pipelines.

Required Skills:

• Strong experience in Apache Kafka (Kafka Streams, Kafka Connect).
• Proficiency in programming languages like Java, Python, or Scala.
• Experience with distributed systems and data streaming concepts.
• Familiarity with Zookeeper, Confluent Kafka, and Kafka Broker configurations.
• Expertise in creating and managing topics, partitions, and consumer groups.
• Hands-on experience with integration tools such as REST APIs, MQ, or ESB.
• Knowledge of cloud platforms like AWS, Azure, or GCP for Kafka deployment.

Nice to Have:

• Experience with monitoring tools like Prometheus, Grafana, or Datadog.
• Exposure to DevOps practices, CI/CD pipelines, and infrastructure automation.
• Knowledge of data serialization formats like Avro, Protobuf, or JSON.

Qualifications :

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 4+ years of hands-on experience in Kafka integration projects.