Data Engineer (PhD) – Scale ML Infra & Lakehouse

ByteDance; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

ByteDance is seeking a Data Engineer Graduate (PhD) in Singapore to join the TikTok Recommendation Ecosystem Architecture team. The role focuses on building a unified infrastructure for training data and inference states used across search, recommendation, and advertising.

You will design real-time and offline data architectures, build scalable Lakehouse systems, and collaborate with ML platforms to optimize PyTorch workflows and large-scale data formats.

Qualifications

• PhD in Artificial Intelligence, Software Development, Computer Science or related field.
• Experience building large-scale distributed systems (storage, streaming, ML infra).
• Understanding of Apache Flink internals; hands-on with state management, connectors, or UDFs.
• Familiarity with Lakehouse technologies (Paimon, Iceberg, Delta Lake, or Hudi) especially incremental ingestion, schema evolution, snapshot isolation.

Responsibilities

• Design and implement real-time and offline data architecture for large-scale recommendation systems.
• Build scalable streaming Lakehouse systems powering feature pipelines, model training, and real-time inference.
• Collaborate with ML platform teams to support PyTorch-based model training workflows and data formats.
• Own core components of distributed storage and processing stack, from file format to metadata management.

Skills

Distributed systems

Apache Flink internals

State management/UDFs

Lakehouse technologies

PyTorch integration

Java/Scala/C++

Data formats

Performance tuning

Education

PhD in AI/CS/related field

Tools

Apache Flink

Apache Paimon

Iceberg

Delta Lake

Hudi

Parquet/ORC/Lance

Job description

ByteDance is seeking a Data Engineer Graduate (PhD) in Singapore to join the TikTok Recommendation Ecosystem Architecture team. The role focuses on building a unified infrastructure for training data and inference states used across search, recommendation, and advertising.

You will design real-time and offline data architectures, build scalable Lakehouse systems, and collaborate with ML platforms to optimize PyTorch workflows and large-scale data formats.