Senior Java Developer with Big Data Experience

Capgemini Singapore Pte Ltd; Singapore; On-site; SGD 110,000 - 170,000; Full time

Job summary

Capgemini Singapore is seeking a Senior Java Developer with at least 8 years of software development experience, including 5 years in Java/J2EE. The role focuses on building enterprise-grade applications and data-driven solutions using Hadoop and Spark.

You will design RESTful services, implement scalable data pipelines, and manage messaging systems like Kafka and RabbitMQ. Collaboration with cross-functional teams and adherence to CI/CD and TDD practices are essential.

Qualifications

• 8+ years of software development experience, with strong Java/J2EE skills.
• Hands-on Big Data experience with Spark Streaming and Spark.
• Experience with Hadoop ecosystem (HDFS, HBase, Hive, ORC/Parquet).
• Proven ability to design RESTful APIs and implement TDD with JUnit.
• Experience with CI/CD and version control (Jenkins, Git, SVN).
• Familiarity with UML and system design documentation.

Responsibilities

• Design, develop, and maintain Java/J2EE applications for enterprise systems.
• Build scalable data ingestion/processing pipelines using Spark.
• Implement and manage messaging systems like Kafka, Flume, ActiveMQ, RabbitMQ.
• Work with Hadoop stack to manage HDFS, Hive, and columnar formats.
• Create RESTful web services for system integration.
• Maintain CI/CD pipelines with Jenkins/TeamCity and automate builds.
• Collaborate with cross-functional teams using Jira/QC to track progress.
• Apply TDD practices with JUnit to ensure high-quality code.

Skills

Java/J2EE

Big Data

Spark Streaming

Kafka

Hadoop

RESTful APIs

JIRA

CI/CD

JUnit

GIT

SVN

Maven

SBT

Ant

Jenkins

TeamCity

UML

Hive

HDFS

Parquet/ORC

Tools

Maven

SBT

Ant

Jenkins

TeamCity

SVN

GIT

Jira

Quality Center

Job description

We are seeking a highly skilled Senior Java Developer with extensive experience in software development and Big Data technologies to join our dynamic team at Capgemini, Singapore. The ideal candidate will bring at least 8 years of software development expertise, including a minimum of 5 years specializing in Java/J2EE development, and will have hands‑on experience with data processing and messaging systems.

Key Responsibilities:

• Design, develop, and maintain robust Java/J2EE applications to support enterprise‑level systems.
• Build and optimize scalable, high‑performance data ingestion and processing pipelines using technologies like Spark Streaming and Spark.
• Implement and manage messaging systems such as Kafka, Flume, ActiveMQ, MQSeries, or RabbitMQ.
• Work with Hadoop (preferably Hortonworks distribution) to manage HDFS, HBase, Hive, and ORC/Parquet file formats.
• Leverage build tools such as Maven, sbt, or Ant to streamline development workflows.
• Design and develop RESTful web services to enable seamless integration across systems.
• Perform source code management using SVN/GIT and ensure version control practices are adhered to.
• Implement test‑driven development (TDD) practices using Junit to deliver high‑quality code.
• Configure and maintain CI/CD pipelines using Jenkins or TeamCity for automated builds and deployments.
• Collaborate with cross‑functional teams to track and manage project progress using Jira or Quality Center (QC).
• Utilize UML for effective system and application design documentation.

Required Skills and Experience:

• Software Development: At least 8 years of experience in software development, with strong proficiency in Java/J2EE.
• Big Data: Hands‑on experience with data ingestion and processing technologies like Spark Streaming and Spark.
• Messaging Systems: Proficiency with messaging platforms such as Kafka, Flume, ActiveMQ, MQSeries, or RabbitMQ.
• Hadoop Ecosystem: Solid understanding and hands‑on experience with Hadoop components including HDFS, HBase, Hive, and data storage formats like ORC/Parquet.
• Build and Deployment: Experience with build tools (Maven/sbt/Ant), CI/CD tools (Jenkins/TeamCity), and source control tools (SVN/GIT).
• Testing and Debugging: Expertise in TDD practices using Junit and familiarity with debugging tools.
• Project Management Tools: Experience using Jira or Quality Center (QC) for project tracking.
• Web Services: Strong knowledge of RESTful API development and integration.
• System Design: Proficiency in UML for modeling and documenting application designs.

Preferred Qualifications:

• Experience with Hortonworks Hadoop distribution.
• Knowledge of Agile methodologies and experience working in Agile teams.
• Strong analytical and problem‑solving skills with a focus on delivering business value.