AI Infrastructure Architect — LLMs & Agent Platforms

TikTok; San Jose (CA); On-site; USD 162,000 - 388,000; Full time

Job summary

TikTok Content Ecology team builds core algorithm systems for content understanding and governance, applying multimodal large models to support search, local services, and global safety across hundreds of millions of users.

We seek exceptional Researchers/Architects in LLM/Agent Platform to design scalable infrastructure, reusable pipelines, registries, and tool-use/memory components for next-generation AI at TikTok's scale.

Qualifications

• BS/BA or Master's in Computer Science or related technical field or equivalent technical experience.
• ,

Responsibilities

• Architect and build standardized, configurable, and reusable pipelines for the entire lifecycle of models and agents—from data processing and training to deployment, monitoring, and governance.
• Build robust observability and evaluation frameworks to ensure reproducibility, reliability, and cost-efficiency of AI workloads at scale.
• Design and implement core platform infrastructure, including model/agent registries, feature stores, and high-throughput retrieval/RAG systems.
• Design, build, and optimize advanced Agentic AI systems, focusing on core components like planning, tool use, and memory.

Skills

ML engineering

Distributed systems

AI infrastructure

Experiment reproducibility

Deep learning frameworks

Communication skills

Knowledge discovery integration

Education

Bachelor's/Master's in CS or related field

PhD in CS or related field

Tools

PyTorch

TensorFlow

JAX/FLAX

Triton

TensorRT-LLM

FAISS

Milvus

LangChain

LlamaIndex

Job description

TikTok Content Ecology team builds core algorithm systems for content understanding and governance, applying multimodal large models to support search, local services, and global safety across hundreds of millions of users.

We seek exceptional Researchers/Architects in LLM/Agent Platform to design scalable infrastructure, reusable pipelines, registries, and tool-use/memory components for next-generation AI at TikTok's scale.