Senior Big Data Engineer - Spark & Hadoop Expert

NTT Data Singapore; Singapore; Vor Ort; SGD 95.000 - 150.000; Vollzeit

Zusammenfassung

NTT Data Singapore is seeking a skilled Big Data engineer with 5+ years of experience to develop and maintain enterprise-class data applications in a banking environment.

The role requires deep expertise in Hadoop, Spark, Hive, and related tools, plus strong communication and collaboration across cross-functional teams. Proficiency in CI/CD, Linux shell scripting, and Agile practices is essential.

Qualifikationen

• University graduate in Computer Science or related discipline.
• 5-7 years of experience in developing, maintaining and supporting enterprise class big data applications, preferably in banking.
• Proficient in big data technologies/tools/platforms such as Hadoop, HDFS, Hive, Impala, Presto, Spark, Zeppelin, Yarn, Cloudera, Hortonworks.
• Experience with relational databases and Spark performance tuning; Java Spark preferred but not mandatory.
• Knowledge of CI/CD with Jenkins, Git and Bitbucket; Linux shell scripting.
• Familiar with Parquet/ORC/AVRO/JSON formats and microservices architecture.
• Strong communication, analytical skills, and experience in Agile environments.

Aufgaben

• Develop and maintain enterprise-grade big data applications.
• Tune Spark jobs for performance and reliability.
• Collaborate with cross-functional and cross-regional teams.
• Adhere to best practices for Spark programming and data processing.
• Participate in CI/CD pipelines and code reviews.

Kenntnisse

Big Data

Spark

Hadoop

Hive

Python/Java

CI/CD

Linux Shell

Communication

Agile

Ausbildung

University Graduate in Computer Science or Related discipline

Tools

Hadoop

Spark

Hive

Presto

Zeppelin

Yarn

Cloudera

Hortonworks

Jenkins

Git

Bitbucket

Parquet/ORC/AVRO/JSON

S3

Jobbeschreibung

NTT Data Singapore is seeking a skilled Big Data engineer with 5+ years of experience to develop and maintain enterprise-class data applications in a banking environment.

The role requires deep expertise in Hadoop, Spark, Hive, and related tools, plus strong communication and collaboration across cross-functional teams. Proficiency in CI/CD, Linux shell scripting, and Agile practices is essential.