Senior Big Data Developer

CLPS TECHNOLOGY (SINGAPORE) PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

CLPS Technology (Singapore) PTE. LTD. is seeking a senior Java data engineer to design scalable data solutions, implement parallelism and concurrency patterns, and optimize performance in a cloud-based environment.

You will work with Spark, Hadoop ecosystems, Kibana/ELK, and modern microservices to build robust APIs and reliable data pipelines, with DevOps and CI/CD emphasis.

Qualifications

• Proven experience designing and implementing data-intensive solutions.
• Strong understanding of Java/J2EE, parallelism, and concurrency patterns.
• Experience with Spark/Flink/Storm ecosystems for large-scale data processing.
• Hands-on with HBase and Elasticsearch for CRUD and search workloads.
• Knowledge of messaging and integration (IBM MQ, Kafka).
• Cloud platform experience (AWS, GCP, etc.).
• Familiarity with Maven/Gradle/Jenkins for build, CI/CD, and DevOps.
• Proficiency with Git/GitLab, JUnit, Cucumber, Jira, Sonar.
• Experience with Spring, REST, microservices, and gRPC APIs.
• Knowledge of Kibana and ELK stack for debugging and root-cause analysis.

Skills

Java/J2EE

Java 1.8+

Parallelism

Concurrency

Spark

Flink

Storm

HBase

Elasticsearch

IBM MQ

Kafka

Cloud Platform

Spring

REST

Microservices

Kibana/ELK

Performance tuning

Tools

Maven

Gradle

Jenkins

UML

GitHub Copilot

GIT

GitLab

JUnit

Cucumber

Jira

Sonar

Job description

• Solution design using proven patterns, performance tuning.
• Devops / Release management / production support skills strongly preferred.
• Java/J2EE, Java 1.8 and above is preferred to implement Parallelism and Concurrency.
• Must have knowledge on Spark/Flink/Storm to analyze and transform large amount of data.
• Must have knowledge on HBase, elastic search to perform CRUD operations on big data.
• Must have good understanding on IBM MQ, Kafka for message processing.
• Good knowledge on Cloud Platform (AWS, GCP,etc)
• Should have knowledge on maven, gradle, Jenkins, UML, Github copilot tools to manage and build project.
• Should have knowledge on GIT, GIT Lab, Junit, Cucumber, Jira, Sonar to manage/test source code effectively.
• Should have good knowledge on Spring, Spring REST, Web services, gRPC, Micro services, framework to implement robust API’s.
• Must have knowledge on Kibana, spark UI, ELK to debug and identify the root cause of the issues.