Data Engineer

NTT Data Singapore; Singapore; Presencial; SGD 180.000 - 240.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Restaurant d'entreprise

Indemnités de stage/alternance

Descripción de la vacante

NTT Data Singapore is seeking an experienced Big Data Engineer to join our data platform team in Singapore. The role focuses on designing and implementing large-scale data processing pipelines using Hadoop, Spark, and related technologies.

You will work across data ingestion, processing, and storage layers to deliver reliable analytics capabilities. The ideal candidate has 7+ years in IT with strong hands-on experience in Spark, Hadoop, and NoSQL databases, plus familiarity with Lambda

Formación

• Bachelor's degree in Computer Science or related field.
• 7+ years IT experience, with at least 5 years in a similar role, ideally in a Big Data tools environment.
• Proficient understanding of distributed computing principles.
• Strong experience of Hadoop, Spark, Iceberg and Spring Boot.
• Experience with building stream-processing systems, using solutions such as Spark-Streaming.
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala.
• Experience with integration of data from multiple data sources.
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.
• Knowledge of various ETL techniques and frameworks.
• Experience with various messaging systems, such as Kafka or RabbitMQ.
• Knowlege with Big Data ML toolkits, such as Mahout, SparkML, or H2O.
• Good understanding of Lambda Architecture, along with its advantages and drawbacks.

Conocimientos

Distributed computing principles

Stream processing concepts

NoSQL concepts

Lambda Architecture knowledge

Big Data principles

Educación

Bachelor's degree in Computer Science or related field

7+ years IT experience, 5+ in similar role

Herramientas

Hadoop

Spark

Iceberg

Spring Boot

Pig

Hive

Impala

Kafka

RabbitMQ

HBase

Cassandra

MongoDB

Mahout

SparkML

H2O

Spark-Streaming

Descripción del empleo

Requirements

• Bachelor's degree in Computer Science or a related field.
• At least 7 years of IT experience of which at least 5 years' experience in similar role, ideally in a Big Data tools
• Proficient understanding of distributed computing principles
• Strong experience of Hadoop, Spark, Iceberg and Spring Boot
• Experience with building stream-processing systems, using solutions such as Spark-Streaming
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Experience with integration of data from multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Knowledge of various ETL techniques and frameworks
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Knowlege with Big Data ML toolkits, such as Mahout, SparkML, or H2O
• Good understanding of Lambda Architecture, along with its advantages and drawbacks