Senior Data Engineer: Real-Time Data Warehousing & ETL

NUVERSE PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Nuverse, ByteDance's gaming unit, is seeking a data engineer to join the Game Technology team in Singapore. You will participate in the construction and operation of offline and real-time data warehouses for the game business and help optimize the data ETL process.

Ideal candidates have 4+ years in big data, experience with Hive, Yarn, Spark, Flink, Kafka, HBase, and proficiency in Python, Java, Scala, or Go, plus Linux and Shell scripting. Gaming experience is a plus.

Qualifications

• Bachelor's degree or above in computer-related majors (4+ years of big data work).
• Proficient in Hive, Yarn, Spark, Flink, Kafka, HBase and able to tune performance.
• Proficient in HQL and at least one of Python, Java, Scala, or Go.
• Familiar with Linux OS and Shell scripting.
• Strong analytical, proactive, and team collaboration skills.

Responsibilities

• Build offline and real-time data warehouses for game business.
• Optimize data ETL processes and troubleshoot ETL problems.
• Contribute to data governance across complex data links.
• Deliver data solutions rapidly leveraging ByteDance big data platforms.

Skills

HQL

Python

Java

Scala

Go

Hive

Yarn

Spark

Flink

Kafka

HBase

Linux

Shell

Data governance

ETL

Big data

Education

Bachelor's degree or above in computer-related majors

Job description

Nuverse, ByteDance's gaming unit, is seeking a data engineer to join the Game Technology team in Singapore. You will participate in the construction and operation of offline and real-time data warehouses for the game business and help optimize the data ETL process.

Ideal candidates have 4+ years in big data, experience with Hive, Yarn, Spark, Flink, Kafka, HBase, and proficiency in Python, Java, Scala, or Go, plus Linux and Shell scripting. Gaming experience is a plus.