Kafka / Integration Engineer

EY; New Delhi; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

EY in New Delhi, India is seeking a Kafka & integration specialist to design, develop, and manage distributed streaming solutions. You will build producers/consumers, manage clusters, and implement event-driven patterns with RESTful integrations and modern tooling.

The role requires hands-on Kafka experience, Java/Spring Boot or Python, and strong knowledge of integration patterns. Collaboration with DevOps and architecture teams is essential for end-to-end delivery.

Qualifications

• 3-6 years hands-on experience with Apache Kafka (brokers, producers, consumers, Connect, Streams).
• Strong knowledge of Kafka internals, partitions, replication, retention and consumer groups.
• Experience with Java / Spring Boot, or Python for building integration services.
• Solid understanding of integration patterns, message queues, and microservices.
• Experience with REST APIs, JSON, XML, and data serialization formats (Avro/Protobuf).
• Experience with Linux, shell scripting, and system troubleshooting.
• Familiarity with Git, CI/CD tools (Jenkins, GitLab, Azure DevOps, etc.).

Responsibilities

• Design, develop, and manage Kafka topics, partitions, schemas, and related configurations.
• Build and maintain Kafka producers/consumers, connectors, and streaming applications.
• Manage Kafka clusters, monitoring performance, throughput, and availability.
• Implement Kafka Connect (source/sink connectors) and Schema Registry
• Implement event-driven architecture (EDA) and integration design patterns.
• Ensure high availability, scalability, and fault tolerance across integration systems.
• Set up monitoring, logging, and alerting for Kafka & integration platforms (e.g., Prometheus, Grafana, Splunk, ELK).
• Collaborate with architecture, DevOps, and application teams for end-to-end delivery.
• Develop and maintain integration flows using messaging systems (Kafka, MQ, JMS, etc.).
• Implement enterprise API integrations, web services (REST/SOAP), and microservice communication patterns.
• Work with integration tools/frameworks such as Spring Integration, Apache Camel, MuleSoft, or similar.
• Troubleshoot and optimize distributed system performance issues.

Skills

Apache Kafka

Java/Spring Boot

Python

REST APIs

Linux

CI/CD

Tools

Kafka Connect

Schema Registry

Prometheus

Grafana

Splunk

ELK

Spring Integration

Apache Camel

MuleSoft

Job description

Role & responsibilities

• Design, develop, and manage Kafka topics, partitions, schemas, and related configurations.
• Build and maintain Kafka producers/consumers, connectors, and streaming applications.
• Manage Kafka clusters, monitoring performance, throughput, and availability.
• Implement Kafka Connect (source/sink connectors) and Schema Registry
• Implement event-driven architecture (EDA) and integration design patterns.
• Ensure high availability, scalability, and fault tolerance across integration systems.
• Set up monitoring, logging, and alerting for Kafka & integration platforms (e.g., Prometheus, Grafana, Splunk, ELK).
• Collaborate with architecture, DevOps, and application teams for end-to-end delivery.
• Develop and maintain integration flows using messaging systems (Kafka, MQ, JMS, etc.).
• Implement enterprise API integrations, web services (REST/SOAP), and microservice communication patterns.
• Work with integration tools/frameworks such as Spring Integration, Apache Camel, MuleSoft, or similar.
• Troubleshoot and optimize distributed system performance issues.

Preferred candidate profile

• 3-6 years hands-on experience with Apache Kafka (brokers, producers, consumers, Connect, Streams).
• Strong knowledge of Kafka internals, partitions, replication, retention and consumer groups.
• Experience with Java / Spring Boot, or Python for building integration services.
• Solid understanding of integration patterns, message queues, and microservices.
• Experience with REST APIs, JSON, XML, and data serialization formats (Avro/Protobuf).
• Experience with Linux, shell scripting, and system troubleshooting.
• Familiarity with Git, CI/CD tools (Jenkins, GitLab, Azure DevOps, etc.).