Kafka Engineer

Coforge; Greater Noida; Hybrid; INR 2,000,000 - 3,200,000; Full time

Job summary

Coforge in India is seeking an experienced Kafka Engineer with strong expertise in designing, implementing, and supporting event-driven architectures using Apache Kafka. The role focuses on building scalable streaming data platforms, integrating enterprise applications, and ensuring reliability and performance of Kafka ecosystems.

You will design and optimize Kafka topics, producers, consumers, and stream processing applications; install and monitor clusters; and work with cloud platforms,

Qualifications

• Bachelor's degree in CS, Eng, or related field.
• 5+ years of software engineering experience.
• 3+ years hands-on with Apache Kafka.
• Experience in Agile delivery environments.

Responsibilities

• Design, develop, and implement enterprise-grade streaming solutions using Apache Kafka.
• Build real-time data pipelines and event-driven integration architectures.
• Develop Kafka producers, consumers, and stream processing applications.
• Implement topic design, partitioning strategies, replication, and retention policies.
• Optimize Kafka clusters for performance, scalability, and fault tolerance.
• Install, configure, monitor, and maintain Kafka clusters.
• Perform capacity planning, performance tuning, and troubleshooting.
• Ensure high availability and disaster recovery readiness.
• Monitor cluster health using observability and monitoring tools.
• Resolve production incidents and provide L3 support.
• Integrate Kafka with enterprise systems, APIs, databases, cloud platforms, and microservices.
• Develop real-time data ingestion and streaming solutions.
• Work with application teams to define event schemas and messaging standards.
• Implement Schema Registry and data governance standards.
• Automate deployment and operational activities using CI/CD pipelines.
• Support containerized Kafka deployments on Kubernetes/OpenShift.
• Develop Infrastructure-as-Code (Terraform, Ansible, Helm) solutions.
• Implement security controls including authentication, authorization, and encryption.

Skills

Kafka

Java

Spring Boot

Python

REST APIs

Microservices Architecture

AWS Azure GCP

Docker

Kubernetes OpenShift

CI/CD

Education

Bachelor's degree in Computer Science or related field

Tools

Kafka Connect

Kafka Streams

Confluent Platform

Schema Registry

ZooKeeper

MirrorMaker

Job description

Role & responsibilities :

We are seeking an experienced Kafka Engineer with strong expertise in designing, implementing, and supporting event-driven architectures using Apache Kafka. The ideal candidate will be responsible for building scalable, high-performance streaming data platforms, integrating enterprise applications, and ensuring reliability, availability, and performance of Kafka ecosystems.

Key Responsibilities

Kafka Platform Development

• Design, develop, and implement enterprise-grade streaming solutions using Apache Kafka.
• Build real-time data pipelines and event-driven integration architectures.
• Develop Kafka producers, consumers, and stream processing applications.
• Implement topic design, partitioning strategies, replication, and retention policies.
• Optimize Kafka clusters for performance, scalability, and fault tolerance.

Platform Administration & Support

• Install, configure, monitor, and maintain Kafka clusters.
• Perform capacity planning, performance tuning, and troubleshooting.
• Ensure high availability and disaster recovery readiness.
• Monitor cluster health using observability and monitoring tools.
• Resolve production incidents and provide L3 support.

Integration & Development

• Integrate Kafka with enterprise systems, APIs, databases, cloud platforms, and microservices.
• Develop real-time data ingestion and streaming solutions.
• Work closely with application teams to define event schemas and messaging standards.
• Implement Schema Registry and data governance standards.

DevOps & Automation

• Automate deployment and operational activities using CI/CD pipelines.
• Support containerized Kafka deployments on Kubernetes/OpenShift.
• Develop Infrastructure-as-Code (Terraform, Ansible, Helm) solutions.
• Implement security controls including authentication, authorization, and encryption.

Required Technical Skills

Kafka Expertise

• Strong hands-on experience with:
  • Apache Kafka
  • Kafka Connect
  • Kafka Streams
  • Confluent Platform
  • Schema Registry
  • KRaft / ZooKeeper
  • MirrorMaker

Development Skills

• Java, Spring Boot
• Python
• REST APIs
• Microservices Architecture

Cloud & DevOps

• AWS, Azure, or GCP
• Docker
• Kubernetes/OpenShift
• Jenkins/GitHub Actions/Azure DevOps

Monitoring Tools

• Prometheus
• Grafana
• ELK Stack
• Splunk

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 5+ years of software engineering experience.
• 3+ years of hands-on experience with Apache Kafka.
• Experience working in Agile delivery environments.

Preferred Skills

• Confluent Kafka Certification.
• Event-Driven Architecture (EDA) expertise.
• Experience with large-scale distributed systems.
• Knowledge of Avro, Protobuf, and JSON schema management.
• Experience with airline, travel, retail, or financial services domains.

Key Deliverables

• Kafka architecture and solution design.
• Real-time event streaming platform implementation.
• High-availability Kafka cluster setup and management.
• Monitoring and performance optimization dashboards.
• Production support and operational runbooks.

Mandatory Skills- Kafka

Desirable Skills- APACHE KAFKA,KAFKA AND STORM,Java,Spring Boot Docker

Exps - 5yrs to 10yrs

Notice Period - Immediate Joiner to 15 days

location - Greater Noida