LLM and Agent Platform Architect — Scalable AI Infra

TikTok; San Jose (CA); On-site; USD 254,000 - 588,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) with company match

Parental leave

Disability insurance

Life insurance

Wellbeing benefits

Paid holidays

Paid sick days

Paid personal time

Job summary

TikTok is seeking experienced Research Scientists/Architects to join the Content Ecology Algorithm Team. You will help build scalable infrastructure for next-generation LLMs and agents, enabling self-improving capabilities and robust deployment at a global scale.

You'll design pipelines, registries, and memory systems, partnering with algorithm teams to accelerate research and development. This role blends deep technical leadership with impact across TikTok's AI initiatives.

Qualifications

• BS/BA or MS in Computer Science or related technical field or equivalent experience.
• 5+ years of hands-on software engineering with ML, distributed systems, or AI infrastructure.
• Strong proficiency with integrating AI tools into research workflows.
• Familiarity with building robust evaluation frameworks and ensuring reproducibility.
• Expertise in deep learning frameworks and tensor libraries (PyTorch, TensorFlow, JAX/Flax).
• Solid understanding of ML fundamentals and modern AI stack.
• Excellent communication skills to collaborate across teams.

Responsibilities

• Architect and build standardized, configurable pipelines for model/agent lifecycles from data processing to deployment, monitoring, and governance.
• Partner with algorithm teams to provide infrastructure that accelerates research and development cycles.
• Build observability and evaluation frameworks to ensure reproducibility, reliability, and cost-efficiency of AI workloads at scale.
• Design and implement core platform infrastructure, including model/agent registries, feature stores, and high-throughput retrieval/RAG systems.
• Design, build, and optimize advanced Agentic AI systems focusing on planning, tool use, and memory.

Skills

ML Infrastructure

Distributed Systems

AI Research Workflows

Evaluation Frameworks

PyTorch

TensorFlow

JAX/Flax

Communication

Education

BS/BA or MS in Computer Science or related field

Tools

GPU scheduling

Model serving (Triton/TensorRT-LLM)

Vector databases (FAISS, Milvus)

MLOps

Job description

TikTok is seeking experienced Research Scientists/Architects to join the Content Ecology Algorithm Team. You will help build scalable infrastructure for next-generation LLMs and agents, enabling self-improving capabilities and robust deployment at a global scale.

You'll design pipelines, registries, and memory systems, partnering with algorithm teams to accelerate research and development. This role blends deep technical leadership with impact across TikTok's AI initiatives.