Senior AI Infra Engineer - E‑commerce ML/LLM Systems

TikTok USDS Joint Venture; San Jose (CA); On-site; USD 187,000 - 360,000; Full time

Job summary

TikTok USDS Joint Venture seeks an experienced ML/LLM Infrastructure Engineer to design, train, and deploy scalable ML systems. You will own the end-to-end ML/LLM infrastructure and collaborate across teams to deliver high‑performance services in a fast‑growing e‑commerce environment.

This on-site role requires 3+ years of hands-on ML experience and a BS in CS or related field. The base salary range is listed, with potential bonuses and RSUs, focusing on latency and throughput optimization.

Qualifications

• Bachelor's degree in CS, Engineering, or related technical discipline.
• 3+ years building, training, and deploying scalable ML systems.
• Strong CS foundation: algorithms, data structures, software design.
• Proven experience managing technical projects and delivering results.

Responsibilities

• Lead the design, implementation, and operation of scalable ML/LLM infrastructure.
• Collaborate across teams and stakeholders to drive complex engineering efforts.
• Drive technical innovation by integrating emerging technologies.

Skills

ML system development

Algorithm & data structures

Software design patterns

Project leadership

ML/LLM internals

Education

Bachelor's degree in Computer Science, Engineering, or related technical discipline

Tools

vLLM

SGLang

Job description

TikTok USDS Joint Venture seeks an experienced ML/LLM Infrastructure Engineer to design, train, and deploy scalable ML systems. You will own the end-to-end ML/LLM infrastructure and collaborate across teams to deliver high‑performance services in a fast‑growing e‑commerce environment.

This on-site role requires 3+ years of hands-on ML experience and a BS in CS or related field. The base salary range is listed, with potential bonuses and RSUs, focusing on latency and throughput optimization.