Live AI Infra Engineer Intern — GPU & Distributed Systems

TikTok; Singapore; On-site; SGD 17,000 - 23,000; Part time

Job summary

TikTok is offering an internship in its Live Recommendation Architecture Team in Singapore. The role focuses on building scalable, high-performance systems for live broadcast recommendations while gaining hands-on experience with cutting-edge GPU-accelerated training pipelines.

Interns will work on optimizing memory usage, reducing inference latency, and profiling GPU kernels for real-time workloads, alongside ML engineers. Rolling applications and a 3-month minimum commitment are expected.

Qualifications

• Pursuing a Bachelor's or Master's degree in Computer Science, Computer Engineering, Information Systems, or a related technical discipline
• Strong programming skills in C++/CUDA/Python; basic understanding of GPU architecture and distributed training
• Familiarity with deep learning frameworks and basic knowledge of recommendation systems

Responsibilities

• Optimize recommendation model memory usage and inference latency on GPU-based heterogeneous computing systems for live scenarios
• Design and implement high-throughput distributed training and inference pipelines for live broadcast recommendation models
• Perform GPU kernel profiling and performance tuning to optimize real-time inference throughput for live streaming workloads

Skills

C++/CUDA/Python

GPU architecture

Distributed training

Deep learning frameworks

Recommendation basics

Education

Bachelor's/Master's in CS/CE/IS

Tools

NCCL

Horovod

DeepSpeed

FSDP

Job description

TikTok is offering an internship in its Live Recommendation Architecture Team in Singapore. The role focuses on building scalable, high-performance systems for live broadcast recommendations while gaining hands-on experience with cutting-edge GPU-accelerated training pipelines.

Interns will work on optimizing memory usage, reducing inference latency, and profiling GPU kernels for real-time workloads, alongside ML engineers. Rolling applications and a 3-month minimum commitment are expected.