Software Engineer (Big Data), Application Computing

TIKTOK PTE. LTD.; Singapore; Sur place; SGD 100 000 - 150 000; Plein temps

Résumé du poste

TikTok is hiring for a role in its real-time recommendation architecture team. You will design and implement real-time streaming data systems for large-scale TikTok videos, live streams, and e-commerce platforms, focusing on system stability and high availability.

The team builds a unified real-time middleware, scalable storage and computing models, and advanced data systems for deduplication, counting, and feature services across a billion-user product.

Qualifications

• Must have strong programming skills in Java/C++/Scala/Python.
• Proficient in streaming computing with production TB-level Flink systems.
• Experience with data lake technologies (Hudi/Iceberg/Delta Lake).
• Willing to learn new technologies and solve ambiguous problems.

Responsabilités

• Design and implement real-time streaming data systems for large-scale recommendations.
• Create scalable, high-performance storage and compute models.
• Troubleshoot production failures and ensure system stability.
• Build streaming frameworks and distributed systems for massive data workloads.
• Research and develop software, applying CS/engineering principles.
• Analyze user needs and translate into software solutions.
• Update software and drive testing/validation procedures.
• Collaborate with hardware engineers to integrate systems.

Connaissances

Java

C++

Scala

Python

Streaming systems

Flink

Troubleshooting

Formation

Bachelor's degree in CS/EE or related

Outils

FlinkDataStream

FlinkSQL

FlinkCheckpoint

FlinkState

Hudi

Iceberg

DeltaLake

Description du poste

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Job highlights

Positive team atmosphere, Career growth opportunity, Flat organization

Responsibilities

Team Introduction

TikTok's Recommendation Architecture Team is responsible for real-time computing direction, handling the design and development of real-time computing systems for TikTok videos, live streams, e-commerce, and a billion-user product recommendation system. Their main focus is ensuring system stability and high availability. They abstract general real-time computing systems, build a unified recommendation feature middleware, and implement a flexible and scalable high-performance storage system and computing model. This enables advanced real-time data systems for deduplication, counting, feature services, and other recommendation-related business needs.

Responsibilities:

• Design and implement real-time (streaming computing) data systems for large-scale recommendation systems.
• Create flexible, scalable, stable, and high-performance storage systems and computing models.
• Troubleshoot production system failures, design and implement necessary mechanisms and tools to ensure overall stability of the production systems
• Construct industry-leading streaming computing frameworks and other distributed systems to provide reliable infrastructure for massive data and large-scale business systems
• Research, design, and develop computer and network software or specialised utility programs.
• Analyse user needs and develop software solutions, applying principles and techniques of computer science, engineering, and mathematical analysis.
• Update software, enhances existing software capabilities, and develops and direct software testing and validation procedures.
• Work with computer hardware engineers to integrate hardware and software systems and develop specifications and performance requirements.

Qualifications

Minimum Qualifications

• Proficient in programming languages like Java, C++, Scala, Python.
• Strong coding and troubleshooting skills.
• At least 1 year of relevant experience
• Deep understanding of streaming computing systems, with formal production experience in developing TB-level Flink real-time computing systems. Proficient in modules like FlinkDataStream, FlinkSQL, FlinkCheckpoint, FlinkState, and preferably with experience in reading Flink source code.
• Experience in data lake development is preferred. Familiar with at least one data lake technology such as Hudi, Iceberg, DeltaLake, and preferably with experience in reading their source code.
• Willingness to tackle problems without clear answers, with a strong passion for learning new technologies.

Preferred Qualifications

• Experience in handling PB-level data is a plus.
• Familiarity with other big data systems is preferred, including YARN, K8S, Spark, SparkSQL, Kudu, and others.
• Experience in storage systems such as Hbase, Cassandra, RocksDB.