AI/ML Infrastructure Engineer for Large-Scale LLMs

TikTok

San Jose (CA)

On-site

USD 128,000 - 256,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with company match

Paid parental leave

Disability coverage

Wellbeing benefits

Job summary

TikTok is hiring for a role focused on building the next generation of AI infrastructure. You will work on distributed training and online inference systems powering billions of recommendations and large language models, collaborating with researchers to deploy LLM training and serving solutions.

The position requires strong C++/Python skills, experience with PyTorch or TensorFlow, and a solid understanding of transformers and GPUs.

Qualifications

Bachelor's or Master's in Artificial Intelligence, Software Development, Computer Science, or Computer Engineering.
Strong programming in C++ or Python; good understanding of data structures, algorithms, and computer systems.
Familiarity with PyTorch or TensorFlow; knowledge of Transformer architectures and LLMs.

Responsibilities

Build and optimize infrastructure for large-scale model training and online inference.
Develop distributed systems supporting large recommendation models and LLMs.
Improve training and inference performance through GPU optimization and efficient communication.
Collaborate with researchers to develop and deploy LLM training and serving solutions.
Analyze system bottlenecks and implement performance optimizations.