Senior Data Engineer - Gaming Data & ETL Architect

ByteDance; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Nuverse, ByteDance's gaming business unit, is seeking a data engineer to help build and operate offline and real-time data warehouses and data pipelines for our game business.

You will optimize ETL processes, participate in data governance amid complex data ecosystems, and implement data solutions using ByteDance's big data stack.

Qualifications

• Bachelor's degree or above in computer-related majors.
• 4+ years of big data-related work experience.
• Proficient with Hive, Yarn, Spark, Flink, Kafka, and HBase; able to tune performance.
• Proficient in HQL and at least one of Python, Java, Scala, or Go.
• Familiar with Linux and Shell scripting.
• Be proactive at work and able to independently analyze and solve problems.
• Be responsible, have good communication skills and teamwork ability.

Responsibilities

• Participate in the construction and operation and maintenance of offline and real-time data warehouses for game business.
• Participate in the optimization of the data ETL process and solve ETL-related technical problems.
• Participate in data governance work under complex data link dependencies and multi-data content ecology.
• Relying on ByteDance's big data solutions, quickly implement data solutions in the business.

Skills

Big data analytics

Analytical thinking

Problem solving

Communication

Teamwork

Education

Bachelor's degree or above in computer-related majors

Tools

Hive

Yarn

Spark

Flink

Kafka

HBase

Job description

About the TeamNuverse is a gaming business unit in ByteDance. The Game Technology team is playing a significant role in the whole life cycle of the game. We are responsible for the development, testing, operation, SRE, and quality assurance of the user and operating system, and give strong support for game developing and publishing. Providing comprehensive and systematical solutions, support the good operation and commercialization of the game. Responsible for the design and implementation of the deployment architecture of the game's overseas game business, and ensuring the good operation of online services.Job Description:1. Participate in the construction and operation and maintenance of offline and real-time data warehouses for game business;2. Participate in the optimization of the data ETL process and solve ETL-related technical problems;3. Participate in data governance work under complex data link dependencies and multi-data content ecology;4. Relying on ByteDance's big data solutions, quickly implement data solutions in the business.

Qualifications

Minimum Qualifications：1. Bachelor's degree or above in computer-related majors, with more than 4 years of big data-related work experience;2. Master most of the big data-related technologies such as Hive, Yarn, Spark, Flink, Kafka, HBase, understand their principles and be able to complete performance tuning;3. Proficient in using HQL, and master at least one of Python, Java, Scala, and GO;4. Familiar with the Linux operating system and proficient in Shell programming;5. Be proactive at work and be able to independently analyze and solve problems;6. Be responsible, have good communication skills and teamwork ability;Preferred Qualifications:1. Experience in the gaming industry or managing platform-type internet products will be an advantage.

Job Information

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.