Job Title: Senior Java & Kafka developer
Job Type: Full-time
Experience Level: Senior (8+ years of relevant experience)
Position Summary
We are seeking a Senior Software Engineer with a deep specialization in building high-throughput, fault-tolerant, and scalable distributed events processing applications. In this role, you will design and develop event-driven microservices using Java and Spring Boot, utilizing Amazon MSK (Managed Streaming for Apache Kafka) and Confluent Kafka platform for real-time data streaming and event processing.
Key Responsibilities
- Microservices Development: Design, build, and maintain robust backend microservices using Java (17+) and the Spring Boot ecosystem.
- Event-Driven Architecture: Architect and implement real-time data streaming pipelines using Apache Kafka, Amazon MSK, and Confluent Kafka.
- Stream Processing: Develop complex event processing solutions using Kafka Streams, ksqlDB, or Kafka Connectors.
- Schema Management: Implement and enforce data governance strategies using Confluent Schema Registry (Avro, Protobuf, or JSON Schema).
- Performance Tuning: Optimize Kafka consumer/producer configurations, topic partitions, replication factors, and JVM settings for maximum throughput and low latency.
- CI/CD & DevOps: Build automated deployment pipelines using Docker, Kubernetes, and CI/CD tools (Jenkins, GitHub Actions, or GitLab CI).
- Leadership & Collaboration: Provide technical leadership, participate in code reviews, establish best practices, and mentor mid-level developers.
Required Technical Skills
- Core Language: Strong proficiency in Java (Object-Oriented Programming, Concurrency, Memory Management).
- Frameworks: Extensive experience with Spring Boot, Spring Cloud, and Spring for Apache Kafka.
- Kafka Ecosystem: Deep understanding of Kafka internals (brokers, zookeeper/KRaft, commit logs, consumer groups)
- Data Serializers: Experience with Avro, Schema Registry, and managing schema evolution.
- Database & Storage: Experience with SQL/NoSQL databases (Oracle, PostgreSQL, MongoDB, DynamoDB)
- Testing: Proficiency in writing unit and integration tests using JUnit, Mockito, and Testcontainers for Kafka.
Preferred Qualifications & Certifications
- Confluent Certified Developer for Apache Kafka (CCDAK).