Software Engineer-JAVA Bigdata

ClearTrail Technologies Pvt. Ltd.; India; On-site; INR 800,000 - 1,200,000; Full time

Job summary

ClearTrail Technologies Pvt. Ltd. invites a Software Engineer-JAVA Bigdata to join a team handling large-scale data pipelines processing billions of records. You will build high-throughput services interfacing with Kafka, Solr, and HDFS within a Kubernetes environment.

The ideal candidate has a strong foundation in Java, Linux interactions, JVM tuning, and experience with Docker/Kubernetes for cloud-native deployments.

Qualifications

• 2–3 years of Java engineering experience with big data processing.
• Experience with Kafka, Solr, and HDFS in a distributed setup.
• Strong Linux knowledge and distributed storage concepts.
• Familiarity with containerization and Kubernetes for deployments.

Responsibilities

• Design and develop robust Java applications using Spring Boot or microservices.
• Build and optimize Kafka producers/consumers and data serialization.
• Manage data lifecycle in HDFS and S3 with high-speed indexing in Solr.
• Tune JVM performance, GC behavior, and JNI interactions.
• Containerize apps with Docker and deploy on Kubernetes in Linux environments.

Skills

Java

Spring Boot

Microservices

JVM memory management

Performance tuning

Tools

Docker

Kubernetes

Oracle Linux

Kafka

Solr

HDFS

S3

Job description

INNOVATE WITH LEADING-EDGE TECHNOLOGIES TO DEFINE THE FUTURE OF COMMUNICATION INTELLIGENCE

Software Engineer-JAVA Bigdata

• Experience: 2 - 3 Years

Requisition Description
We are looking for a high-performing Java Engineer to join our team managing large-scale data pipelines processing billions of records. You will be responsible for building and optimizing high-throughput services that interface with Kafka, Solr, and HDFS within a Kubernetes environment. The ideal candidate has an 'under the hood' understanding of how Java interacts with Linux and distributed storage.
Roles and Responsibilities Roles and Responsibilities

• Design & Development: Build robust, scalable, and maintainable Java applications using Spring Boot or Microservices architecture.
• Data Orchestration: Develop and optimize Kafka producers/consumers, ensuring efficient data serialization and compression (Snappy/LZ4).
• Big Data Integration: Manage data lifecycle operations within HDFS & S3 and perform high-speed indexing and querying in Solr.
• Performance Tuning: Diagnose and resolve bottlenecks in JVM memory management, Garbage Collection, and JNI-based native library interactions.
• Cloud Native Deployment: Containerize applications using Docker and manage deployments in Kubernetes (K8s) across Oracle Linux environments.