Senior Data Engineer - Game

NUVERSE PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Nuverse, ByteDance's gaming unit, is seeking a data engineer to join the Game Technology team in Singapore. You will participate in the construction and operation of offline and real-time data warehouses for the game business and help optimize the data ETL process.

Ideal candidates have 4+ years in big data, experience with Hive, Yarn, Spark, Flink, Kafka, HBase, and proficiency in Python, Java, Scala, or Go, plus Linux and Shell scripting. Gaming experience is a plus.

Qualifications

• Bachelor's degree or above in computer-related majors (4+ years of big data work).
• Proficient in Hive, Yarn, Spark, Flink, Kafka, HBase and able to tune performance.
• Proficient in HQL and at least one of Python, Java, Scala, or Go.
• Familiar with Linux OS and Shell scripting.
• Strong analytical, proactive, and team collaboration skills.

Responsibilities

• Build offline and real-time data warehouses for game business.
• Optimize data ETL processes and troubleshoot ETL problems.
• Contribute to data governance across complex data links.
• Deliver data solutions rapidly leveraging ByteDance big data platforms.

Skills

HQL

Python

Java

Scala

Go

Hive

Yarn

Spark

Flink

Kafka

HBase

Linux

Shell

Data governance

ETL

Big data

Education

Bachelor's degree or above in computer-related majors

Job description

About Bytedance

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join Us

Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us.

About the Team

Nuverse is a gaming business unit in ByteDance. The Game Technology team is playing a significant role in the whole life cycle of the game. We are responsible for the development, testing, operation, SRE, and quality assurance of the user and operating system, and give strong support for game developing and publishing. Providing comprehensive and systematical solutions, support the good operation and commercialization of the game. Responsible for the design and implementation of the deployment architecture of the game's overseas game business, and ensuring the good operation of online services.

Job Description:

1. Participate in the construction and operation and maintenance of offline and real-time data warehouses for game business;

2. Participate in the optimization of the data ETL process and solve ETL-related technical problems;

3. Participate in data governance work under complex data link dependencies and multi-data content ecology;

4. Relying on ByteDance's big data solutions, quickly implement data solutions in the business.

Qualifications

Minimum Qualifications：

1. Bachelor's degree or above in computer-related majors, with more than 4 years of big data-related work experience;

2. Master most of the big data-related technologies such as Hive, Yarn, Spark, Flink, Kafka, HBase, understand their principles and be able to complete performance tuning;

3. Proficient in using HQL, and master at least one of Python, Java, Scala, and GO;

4. Familiar with the Linux operating system and proficient in Shell programming;

5. Be proactive at work and be able to independently analyze and solve problems;

6. Be responsible, have good communication skills and teamwork ability;

Preferred Qualifications:

1. Experience in the gaming industry or managing platform-type internet products will be an advantage.

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.