Kafka Integration Specialist

Forward Eye Technologies; Pune District, Delhi; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Forward Eye Technologies in Pune, India is seeking a Kafka Integration Specialist to design, develop, and maintain real-time data pipelines using Apache Kafka, Kafka Streams, and Connect. You will optimize deployments on AWS/Azure/GCP, manage Kafka clusters, ensure fault tolerance, and collaborate with cross-functional teams to meet data integration requirements.

4+ years of hands-on experience strongly preferred.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 4+ years of hands-on experience in Kafka integration projects.
• Experience designing, developing, and maintaining Kafka-based data pipelines.

Responsibilities

• Design, implement, and maintain Kafka-based data pipelines.
• Develop integration solutions using Kafka Connect, Kafka Streams, and other related technologies.
• Manage Kafka clusters, ensuring high availability, scalability, and performance.
• Collaborate with cross-functional teams to understand integration requirements and deliver robust solutions.
• Implement best practices for data streaming, including message serialization, partitioning, and replication.
• Monitor and troubleshoot Kafka performance, latency, and security issues.
• Ensure data integrity and implement failover strategies for critical data pipelines.

Skills

Kafka

Java

Python

Scala

Distributed systems

Zookeeper

Confluent Kafka

Kafka Connect

REST APIs

AWS

Azure

GCP

Education

Bachelor's degree in CS/IT

Tools

MQ

ESB

Kafka Broker Configs

Job description

Job Title : Kafka Integration Specialist

We are seeking a highly skilled Kafka Integration Specialist to join our team. The ideal candidate will have extensive experience in designing, developing, and integrating Apache Kafka solutions to support real-time data streaming and distributed systems.

Key Responsibilities

• Design, implement, and maintain Kafka-based data pipelines.
• Develop integration solutions using Kafka Connect, Kafka Streams, and other related technologies.
• Manage Kafka clusters, ensuring high availability, scalability, and performance.
• Collaborate with cross-functional teams to understand integration requirements and deliver robust solutions.
• Implement best practices for data streaming, including message serialization, partitioning, and replication.
• Monitor and troubleshoot Kafka performance, latency, and security issues.
• Ensure data integrity and implement failover strategies for critical data pipelines.

Required Skills

• Strong experience in Apache Kafka (Kafka Streams, Kafka Connect).
• Proficiency in programming languages like Java, Python, or Scala.
• Experience with distributed systems and data streaming concepts.
• Familiarity with Zookeeper, Confluent Kafka, and Kafka Broker configurations.
• Expertise in creating and managing topics, partitions, and consumer groups.
• Hands-on experience with integration tools such as REST APIs, MQ, or ESB.
• Knowledge of cloud platforms like AWS, Azure, or GCP for Kafka deployment.

Nice to Have

• Experience with monitoring tools like Prometheus, Grafana, or Datadog.
• Exposure to DevOps practices, CI/CD pipelines, and infrastructure automation.
• Knowledge of data serialization formats like Avro, Protobuf, or JSON.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 4+ years of hands-on experience in Kafka integration projects.