Senior LLM & Agent Infrastructure Architect

TikTok; San Jose (CA); On-site; USD 254,000 - 588,000; Full time

Job summary

TikTok's Content Ecology Algorithm Team seeks exceptional researchers and architects to build the bones of next-generation AI and Agent platforms at global scale. You will design and implement novel LLM/Agent frameworks with self-improving capabilities and architect robust, high-performance infrastructure.

This role focuses on scalable pipelines for data processing, model training, deployment, monitoring and governance, collaborating with algorithm teams to accelerate research and development

Qualifications

• BS/BA or MS in CS or related field.
• 5+ years in software engineering with ML/AI infra.
• Experience with PyTorch, TensorFlow, or JAX.
• Strong collaboration and communication skills.

Responsibilities

• Architect and build scalable model/agent pipelines.
• Collaborate with algorithm teams to accelerate research.
• Develop observability and evaluation frameworks.
• Design core platform infra: registries, feature stores, retrieval systems.
• Build Agentic AI systems focusing on planning, tools, memory.

Skills

AI tooling integration

Evaluation frameworks

PyTorch

TensorFlow

JAX/FLAX

Machine learning fundamentals

Communication skills

Education

BS/BA or Master in CS

PhD in CS or related

Tools

LangChain

LlamaIndex

Triton

TensorRT-LLM

FAISS

Milvus

DeepSpeed/ZeRO

vLLM

Job description

TikTok's Content Ecology Algorithm Team seeks exceptional researchers and architects to build the bones of next-generation AI and Agent platforms at global scale. You will design and implement novel LLM/Agent frameworks with self-improving capabilities and architect robust, high-performance infrastructure.

This role focuses on scalable pipelines for data processing, model training, deployment, monitoring and governance, collaborating with algorithm teams to accelerate research and development