Graduate AI Infra Engineer: LLM & GPU Systems

TikTok; San Jose (CA); On-site; USD 162,000 - 388,000; Full time

Job summary

TikTok is seeking a Software Engineer to join the Model Infrastructure team, building scalable infrastructure for For You recommendations and large language models. You will work on distributed training and online inference, GPU optimization, and deploying LLM training/serving solutions.

The role targets graduates with strong CS fundamentals and hands-on experience in AI systems. Expect collaboration with researchers and impact on billions of users worldwide.

Qualifications

• PhD candidates or recent graduates in CS or related field.
• Strong coding skills in C++ or Python.
• Solid understanding of data structures and algorithms.
• Experience with PyTorch or TensorFlow.
• Knowledge of Transformer architectures and LLMs.

Responsibilities

• Build and optimize infrastructure for large-scale model training and online inference.
• Develop distributed systems supporting large recommendation models and LLMs.
• Improve training and inference performance through GPU optimization and efficient communication.
• Collaborate with researchers to develop and deploy LLM training and serving solutions.
• Analyze system bottlenecks and implement performance optimizations.

Skills

PhD in CS (or related)

C++ or Python

Data structures & algorithms

PyTorch or TensorFlow

Transformer architectures / LLMs

Problem solving & large-scale systems

Education

PhD in Computer Science or related field

Tools

GPU programming

Job description

TikTok is seeking a Software Engineer to join the Model Infrastructure team, building scalable infrastructure for For You recommendations and large language models. You will work on distributed training and online inference, GPU optimization, and deploying LLM training/serving solutions.

The role targets graduates with strong CS fundamentals and hands-on experience in AI systems. Expect collaboration with researchers and impact on billions of users worldwide.