Senior Data Engineer - Game

ByteDance; Singapore; Sur place; SGD 90 000 - 150 000; Plein temps

Résumé du poste

Nuverse, ByteDance's gaming business unit, is seeking a data engineer to help build and operate offline and real-time data warehouses and data pipelines for our game business.

You will optimize ETL processes, participate in data governance amid complex data ecosystems, and implement data solutions using ByteDance's big data stack.

Qualifications

• Bachelor's degree or above in computer-related majors.
• 4+ years of big data-related work experience.
• Proficient with Hive, Yarn, Spark, Flink, Kafka, and HBase; able to tune performance.
• Proficient in HQL and at least one of Python, Java, Scala, or Go.
• Familiar with Linux and Shell scripting.
• Be proactive at work and able to independently analyze and solve problems.
• Be responsible, have good communication skills and teamwork ability.

Responsabilités

• Participate in the construction and operation and maintenance of offline and real-time data warehouses for game business.
• Participate in the optimization of the data ETL process and solve ETL-related technical problems.
• Participate in data governance work under complex data link dependencies and multi-data content ecology.
• Relying on ByteDance's big data solutions, quickly implement data solutions in the business.

Connaissances

Big data analytics

Analytical thinking

Problem solving

Communication

Teamwork

Formation

Bachelor's degree or above in computer-related majors

Outils

Hive

Yarn

Spark

Flink

Kafka

HBase

Description du poste

About the Team

Nuverse is a gaming business unit in ByteDance. The Game Technology team is playing a significant role in the whole life cycle of the game. We are responsible for the development, testing, operation, SRE, and quality assurance of the user and operating system, and give strong support for game developing and publishing. Providing comprehensive and systematical solutions, support the good operation and commercialization of the game. Responsible for the design and implementation of the deployment architecture of the game's overseas game business, and ensuring the good operation of online services.

Responsibilities

• Participate in the construction and operation and maintenance of offline and real-time data warehouses for game business.
• Participate in the optimization of the data ETL process and solve ETL-related technical problems.
• Participate in data governance work under complex data link dependencies and multi-data content ecology.
• Relying on ByteDance's big data solutions, quickly implement data solutions in the business.

Qualifications

• Bachelor's degree or above in computer-related majors, with more than 4 years of big data-related work experience.
• Master most of the big data-related technologies such as Hive, Yarn, Spark, Flink, Kafka, HBase, understand their principles and be able to complete performance tuning.
• Proficient in using HQL, and master at least one of Python, Java, Scala, and GO.
• Familiar with the Linux operating system and proficient in Shell programming.
• Be proactive at work and be able to independently analyze and solve problems.
• Be responsible, have good communication skills and teamwork ability.

Preferred Qualifications

• Experience in the gaming industry or managing platform-type internet products will be an advantage.