NPU Architect Engineer: AI Chip Hardware Design

TikTok Inc.; San Jose (CA); On-site; USD 162,000 - 317,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) with company match

Paid parental leave

Disability coverage

Life insurance

Wellbeing benefits

Paid holidays

Paid sick days

Paid personal time

Job summary

TikTok is seeking a senior hardware design engineer in San Jose to architect and optimize video codec accelerators on ASIC/FPGA platforms. You will work with teams across algorithm, software, firmware, and hardware to push high-performance video processing at scale, influencing compute throughput and memory bandwidth.

Ideal candidates have deep knowledge of computer architecture, DL algorithms on chips, and experience with LLM inference.

Qualifications

• Master's degree or above in Microelectronics, Electronic Engineering, Integrated Circuits, Computer Science, or a related field.
• Familiarity with Tensor Core; relevant experience in hardware acceleration for large language models.
• Solid knowledge of computer architecture and digital integrated circuit design.
• Familiarity with deep learning algorithms in areas such as large language models and CNNs.
• Familiarity with distributed frameworks for large language model inference; understanding of how to compute the performance of AI model inference on chips.
• Strong independent problem-solving skills, good communication and teamwork abilities, a strong desire to learn, the initiative to stay current with evolving trends in AI algorithms and chip architecture, and a forward-looking technical vision.

Responsibilities

• Hardware architecture design, architectural performance analysis, and optimization of key NPU modules in next-generation chips.
• Performance modeling and analysis of emerging deep learning algorithms on chip systems; deliver inference performance for different models and assist in defining chip specifications such as compute throughput, bandwidth, and memory.
• Architecture optimization targeting real-world application scenarios, achieving hardware-software co-optimization design.
• Authoring architecture specification documents for key chip modules, and guiding the design implementation, optimization, and verification of the microarchitecture.

Skills

Tensor Core

Hardware acceleration

Computer architecture

DL algorithms

LLM inference

Problem solving

Communication

Teamwork

Education

Master's degree or above in Microelectronics/Electronic Engineering/ICs/CS

Tools

Palladium

ZeBu

JasperGold

Job description

TikTok is seeking a senior hardware design engineer in San Jose to architect and optimize video codec accelerators on ASIC/FPGA platforms. You will work with teams across algorithm, software, firmware, and hardware to push high-performance video processing at scale, influencing compute throughput and memory bandwidth.

Ideal candidates have deep knowledge of computer architecture, DL algorithms on chips, and experience with LLM inference.