AI Infra Engineer: Scalable LLM & GPU Systems

TikTok; San Jose (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

401(k) Savings Plan With Company Match

Paid Parental Leave

Short-term Disability Coverage

Long-term Disability Coverage

Life Insurance

Wellbeing Benefits

Paid Holidays

Paid Sick Days

Paid Personal Time

Job summary

TikTok is building and optimizing infrastructure for large-scale model training and online inference in recommendation systems and LLMs. You will develop distributed systems and implement GPU optimizations to improve performance and scalability.

Requirements include a Bachelor's degree in Computer Science, strong programming in C++ or Python, and knowledge of Transformer architectures, LLMs, and familiarity with PyTorch or TensorFlow.

Qualifications

• Bachelor's degree in Computer Science or related field.
• Strong programming skills in C++ or Python.
• Knowledge of Transformer architectures, LLMs, and familiarity with PyTorch or TensorFlow.

Skills

C++

Python

PyTorch

TensorFlow

Distributed Computing

GPU Optimization

CUDA

Triton

Transformer Architectures

LLM Infrastructure

Data Structures

Algorithms

Education

Bachelor's degree in Computer Science

Tools

PyTorch

TensorFlow

Job description

TikTok is building and optimizing infrastructure for large-scale model training and online inference in recommendation systems and LLMs. You will develop distributed systems and implement GPU optimizations to improve performance and scalability.

Requirements include a Bachelor's degree in Computer Science, strong programming in C++ or Python, and knowledge of Transformer architectures, LLMs, and familiarity with PyTorch or TensorFlow.