Senior GPU/AI Platform Architect

TikTok Inc.; San Jose (CA); On-site; USD 162,000 - 388,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) with company match

Paid parental leave

Disability coverage

Life insurance

Wellbeing benefits

10 holidays per year

10 sick days per year

17 days Paid Personal Time

Job summary

TikTok Inc. is seeking a Senior Server Platform Architect to lead the design and implementation of high-performance GPU/AI server platforms. You will work with top engineers to explore new AI hardware, accelerators, interconnects, and memory systems for massive-scale workloads.

The role emphasizes performance optimization, architecture exploration, and collaboration with partners. International travel is required up to four times per year, and compensation includes base salary plus incentives

Qualifications

• Master's degree or higher in Electrical Engineering, Computer Engineering, Computer Science or related majors.
• Deep understanding of computer system architecture, especially on GPU/AI SoC or Platform Architecture, Interconnect Fabric, and Memory sub-system.
• Experience in GPU/AI system application performance optimization or software hardware co-design.
• Understand LLM model architecture, training and inference requirements on accelerator/memory/network.
• Understand the implementation of GPU/AI virtualization technology, deep learning architecture, and distributed system.

Responsibilities

• Track GPU/AI LLM technology from industry and partner vendors; evaluate and test the new part or technology, integrate the technology into the system.
• Drive GPU/AI LLM platform customization via application performance optimizations and architecture explorations to increase system Perf/TCO.
• Drive GPU/AI LLM new technology solution study and implementation.
• Evaluate GPU system performance under state-of-the-art LLM applications.
• Collaborate with industry consortia and open standard committees to investigate emerging technologies or standards and contribute research results.
• Work with our technology partners and suppliers to setup POC or prototypes to evaluate and test new technologies or architectural designs.
• International travel requirement: up to four times per year; valid passport and visas required.

Skills

GPU/AI architecture

Performance optimization

Software/hardware co-design

LLM training/inference

Distributed systems

Education

Master's degree or higher in EE/CE/CS

Tools

GPU virtualization

System architecture tooling

Job description

TikTok Inc. is seeking a Senior Server Platform Architect to lead the design and implementation of high-performance GPU/AI server platforms. You will work with top engineers to explore new AI hardware, accelerators, interconnects, and memory systems for massive-scale workloads.

The role emphasizes performance optimization, architecture exploration, and collaboration with partners. International travel is required up to four times per year, and compensation includes base salary plus incentives