Walk-in | Senior Java Developer (Kafka Specialist)

Etrans Solutions; Bidhannagar; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Etrans Solutions is seeking an experienced Java/Kafka engineer to design and implement scalable microservices in a streaming-heavy environment. You will work with Spring Boot, Kafka, and modern DevOps tooling to deliver robust data processing solutions.

You will mentor juniors, champion TDD, and help optimize data workflows using CQRS and SAGA patterns in a distributed system landscape.

Qualifications

• Java 17+ with strong Core Java concepts (collections, concurrency, streams)
• Deep knowledge of Apache Kafka and related ecosystem components
• Experience designing microservices architectures (EDA, CQRS, SAGA)
• Hands-on with Spring Boot (Web, Data, Security) and Spring Cloud
• Experience with Docker and Kubernetes in production
• CI/CD pipelines and build tools (Jenkins, GitHub Actions, Maven/Gradle)
• SQL/NoSQL databases (PostgreSQL/MySQL, MongoDB/Cassandra/Redis)
• Observability tooling (Prometheus, Grafana, ELK)

Responsibilities

• Design, build, and maintain scalable microservices with Java 17/21 and Spring Boot.
• Architect real-time data streaming solutions with Apache Kafka.
• Tune Kafka producers/consumers for throughput/latency; handle exactly-once semantics, DLQ, replaying.
• Decompose monoliths into distributed microservices; apply CQRS/SAGA patterns.
• Lead code reviews, enforce TDD, mentor engineers on concurrency and stream processing.
• Collaborate with DevOps to manage Kafka clusters and deploy via Docker/Kubernetes.

Skills

Java

Java 17+/Ecosystem

Spring Boot

Kafka

Kafka Streams/Connect

CQRS

SAGA

REST APIs

Docker

Kubernetes

CI/CD

Maven/Gradle

Git

Data modeling

Observability

Tools

Docker

Kubernetes

Jenkins

Git

GitHub Actions

Maven

Gradle

Kafka Tools

Schema Registry

Job description

Key Responsibilities

• Core Development: Design, build, and maintain scalable microservices using Java (17/21) and Spring Boot.
• Event-Driven Architecture: Architect and implement real-time data streaming solutions using Apache Kafka. This includes configuring topics, partitions, and replication factors for high availability.
• Kafka Optimization: Tune Kafka producers and consumers for optimal throughput and latency. Handle complex scenarios like exact-once semantics, dead-letter queues, and message replaying.
• System Design: Decompose monolithic applications into distributed microservices. Ensure data consistency across services using patterns like SAGA or CQRS.
• Quality & Mentorship: Lead code reviews, enforce TDD (Test Driven Development), and mentor junior engineers on best practices for concurrency and stream processing.
• DevOps Integration: Collaborate with DevOps to manage Kafka clusters (on-prem or Confluent Cloud) and deploy services using Docker and Kubernetes.

Required Technical Skills (The "Must-Haves")

Category

Essential Skills & Knowledge

Java Ecosystem

Java 17+, Core Java (Collections, Concurrency/Multithreading), Streams API, Lambdas.

Streaming (Critical)

Apache Kafka (Deep Dive):

Understanding of Brokers, Zookeeper/KRaft, Consumer Groups, Offsets, Partitioning strategies, and Log Compaction.

Kafka Ecosystem:

Kafka Streams API, Kafka Connect, Schema Registry (Avro/Protobuf).

Frameworks

Spring Boot (Web, Data, Security), Spring Cloud (Gateway, Circuit Breaker).

Architecture

Microservices, Event-Driven Architecture (EDA), RESTful APIs, Distributed Systems patterns (CQRS, SAGA).

Databases

SQL:

PostgreSQL or MySQL (complex queries, indexing).

NoSQL:

MongoDB, Cassandra, or Redis (caching).

DevOps & Tools

Docker, Kubernetes (K8s), CI/CD pipelines (Jenkins/GitLab/GitHub Actions), Maven/Gradle, Git.

Nice-to-Have Skills (The "Good-to-Haves")

• Observability tools: Prometheus, Grafana, ELK Stack (Elasticsearch, Logstash, Kibana)