AI Infra Engineer Intern: Scale LLM Systems

TikTok; San Jose (CA); Hybrid; USD 52,000 - 72,000; Part time

Benefits offered by this job

Health insurance

Paid holidays

Housing allowance

Job summary

TikTok is seeking a Software Engineer Intern to join the Model Infrastructure team in San Jose. You will help build the next generation of infrastructure powering the For You recommendations and large language models, focusing on distributed training, online inference, and GPU optimization.

This internship offers hands-on experience, collaboration with researchers and engineers, and the opportunity to contribute to production-scale AI systems that touch hundreds of millions of users.

Qualifications

• Pursuing a Bachelor's degree in Computer Science or related field.
• Strong programming skills in C++ or Python.
• Familiarity with PyTorch or TensorFlow.
• Knowledge of Transformer architectures and Large Language Models (LLMs).
• Hands-on experience with LLM training or inference preferred.

Responsibilities

• Build and optimize infrastructure for large-scale model training and online inference.
• Develop distributed systems supporting large recommendation models and LLMs.
• Improve training and inference performance through GPU optimization and efficient communication.
• Collaborate with researchers to deploy LLM training and serving solutions.
• Analyze system bottlenecks and implement performance optimizations.

Skills

C++

Python

Education

Bachelor's degree in Computer Science or related

Master's degree in Computer Science or related

Tools

PyTorch

TensorFlow

CUDA

Triton

Job description

TikTok is seeking a Software Engineer Intern to join the Model Infrastructure team in San Jose. You will help build the next generation of infrastructure powering the For You recommendations and large language models, focusing on distributed training, online inference, and GPU optimization.

This internship offers hands-on experience, collaboration with researchers and engineers, and the opportunity to contribute to production-scale AI systems that touch hundreds of millions of users.