LLM & Agent Platform Architect — Research Scientist

TikTok; San Jose (CA); On-site; USD 360,000 - 588,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) with company match

Paid parental leave

Disability coverage

Life insurance

Wellbeing benefits

Paid holidays

Job summary

TikTok is seeking a Senior Research Scientist/Software Engineer to architect and implement scalable LLM/Agent platform infrastructure in San Jose. You will partner with algorithm teams and design high-performance systems for training, deployment, monitoring, and governance of AI workloads.

Role emphasizes building novel LLM/Agent frameworks, planning, tool use, and memory components, with opportunities to shape AI at a leading tech company.

Qualifications

• BS/BA or MS in Computer Science or related field or equivalent experience.
• 5+ years in software engineering with ML, distributed systems, or AI infrastructure.
• Strong proficiency in integrating AI tools into research workflows.
• Familiarity with evaluation frameworks and reproducibility.

Responsibilities

• Architect and build scalable pipelines for model and agent lifecycles (data processing, training, deployment, monitoring, governance).
• Partner with algorithm teams to deliver a robust infrastructure platform.
• Develop observability and evaluation frameworks for reproducibility and cost-efficiency.
• Design core platform infra like model/agent registries, feature stores, and high-throughput retrieval/RAG systems.
• Develop Agentic AI systems focusing on planning, tool use, and memory.

Skills

AI infrastructure

Distributed systems

ML research workflows

Communication

Education

BS/BA or MS in CS or related field

PhD in CS or related field (preferred)

Tools

PyTorch

TensorFlow

JAX/FLAX

Triton/TensorRT-LLM

FAISS/Milvus

Job description

TikTok is seeking a Senior Research Scientist/Software Engineer to architect and implement scalable LLM/Agent platform infrastructure in San Jose. You will partner with algorithm teams and design high-performance systems for training, deployment, monitoring, and governance of AI workloads.

Role emphasizes building novel LLM/Agent frameworks, planning, tool use, and memory components, with opportunities to shape AI at a leading tech company.