AI Infrastructure Architect for LLMs & Agents

TikTok; San Jose (CA); On-site; USD 233,000 - 388,000; Full time

Benefits offered by this job

Health insurance

401(k) with company match

Parental leave

Disability coverage

Life insurance

Wellbeing benefits

Paid holidays

Paid personal time off

Job summary

TikTok is seeking a Research Scientist/Architect to join the Content Ecology Algorithm Team in the United States. You will design and implement scalable LLM/Agent frameworks and the high-performance infrastructure that runs these models at global scale.

The role emphasizes building reusable pipelines, registries, and tool/memory architectures, partnering with algorithm teams to accelerate research, deployment, and governance of AI workloads.

Qualifications

• BS/BA or Master's in Computer Science or related technical field or equivalent technical experience.
• 2+ years of hands-on experience in software engineering, with a focus on machine learning, distributed systems, or AI infrastructure.
• Strong proficiency in integrating AI tools into knowledge discovery and research workflows.
• Familiarity with building robust evaluation frameworks and ensuring experimental reproducibility.
• Expertise in deep learning frameworks and tensor libraries like PyTorch, Tensorflow, JAX/FLAX
• Solid understanding of machine learning fundamentals and the modern AI stack.
• Excellent communication skills to collaborate across teams.

Responsibilities

• Architect and build standardized, configurable, and reusable pipelines for the entire lifecycle of models and agents- from data processing and training to deployment, monitoring, and governance.
• Partner with algorithm teams to understand their needs and provide a world-class infrastructure platform that accelerates their research and development cycles.
• Build robust observability and evaluation frameworks to ensure the reproducibility, reliability, and cost-efficiency of AI workloads at scale.
• Design and implement core platform infrastructure, including model/agent registries, feature stores, and high-throughput retrieval/RAG systems.
• Design, build, and optimize advanced Agentic AI systems, focusing on core components like planning, tool use, and memory.

Skills

Software engineering

Machine learning infrastructure

AI tool integration

Experiment reproducibility

PyTorch

TensorFlow

JAX/Flax

Effective communication

Education

BS/BA or MS in Computer Science or related field

PhD in Computer Science (preferred)

Tools

Triton

TensorRT-LLM

FAISS

Milvus

DeepSpeed/ZeRO

vLLM

LangChain

LlamaIndex

Job description

TikTok is seeking a Research Scientist/Architect to join the Content Ecology Algorithm Team in the United States. You will design and implement scalable LLM/Agent frameworks and the high-performance infrastructure that runs these models at global scale.

The role emphasizes building reusable pipelines, registries, and tool/memory architectures, partnering with algorithm teams to accelerate research, deployment, and governance of AI workloads.