LPU Chip Architecture Engineer

Canaan Inc.; Hong Kong; On-site; HKD 600,000 - 900,000; Full time

Job summary

Leadingnation is seeking an experienced AI chip architecture lead to define and optimize the LPU chip architecture based on static dataflow concepts. You will plan computing arrays and on-chip SRAM storage, collaborating with compiler teams to align hardware microarchitecture and scheduling before tape-out, and benchmarking power, latency and bandwidth against GPUs and NPUs.

You will track large model inferences, iterate architecture to support MoE and multimodal models, and contribute to

Qualifications

• Master’s degree or above in Microelectronics, Integrated Circuit, Computer Architecture or related majors.
• Familiar with static dataflow architecture and systolic array architecture; understand Prefill and Decode dual-stage inference for large models.
• Hands-on experience in AI chip / NPU / GPU architecture design with hardware-software co-design capabilities.
• Proficient in chip performance evaluation methodologies, including simulation and analysis of power, latency and throughput.

Responsibilities

• Lead the overall architecture definition of LPU chips based on static dataflow architecture and on-chip SRAM scheduling.
• Collaborate with compiler team to define hardware microarchitecture and co-design; align scheduling early to avoid post-tape-out issues.
• Model and analyze computing power, bandwidth and power consumption; benchmark against GPU and NPU architectures.
• Track MoE and multimodal model inferences; iterate LPU architecture for next-generation models.
• Participate in front-end design and FPGA verification; support tape-out and bring-up testing.
• Research dataflow chip architectures of benchmark manufacturers; deliver competitive analyses and iteration solutions.

Skills

Static dataflow architecture

Systolic array architecture

Hardware-software co-design

Chip performance evaluation

Education

Master’s degree or above in Microelectronics, Integrated Circuit, Computer Architecture or related majors

Job description

Responsibilities

• Lead the overall architecture definition of LPU chips based on the static dataflow architecture, including computing array design and on-chip SRAM storage hierarchy planning. Solve core pain points of high latency and frequent data movement in large model inference scenarios.
• Collaborate with the compiler team in the early stage to define hardware microarchitecture and implement hardware-software co-design. Align scheduling logic in advance to avoid industry pain points caused by non-modifiable hardware scheduling after tape-out.
• Conduct modeling and analysis on the computing power, bandwidth and power consumption of LPU chips. Carry out architecture performance benchmarking and optimization by comparing with traditional GPU and NPU architectures.
• Track the inference requirements of MoE large models and multimodal large models, iterate and upgrade the LPU hardware architecture to adapt to next-generation large model inference scenarios.
• Participate in chip front-end design and FPGA prototype verification, cooperate with the back-end team to complete chip tape-out, and follow up chip bring-up testing and performance optimization.
• Research dataflow chip architectures of overseas benchmark manufacturers including Groq, Etched and Cerebras, and deliver competitive analysis reports and architecture iteration solutions.

Qualifications

• Master’s degree or above in Microelectronics, Integrated Circuit, Computer Architecture or related majors, with no less than 2 years of working experience in AI chip architecture design.
• Familiar with static dataflow architecture and systolic array architecture; understand the principles of Prefill and Decode dual-stage inference for large models. Prior experience in video memory and on-chip SRAM scheduling is preferred.
• Hands‑on experience in AI chip / NPU / GPU architecture design, familiar with chip front-end design flow, with solid hardware‑software co‑design capabilities.
• Proficient in chip performance evaluation methodologies, capable of independently completing simulation and analysis of computing power, latency and power consumption.

Preferred Skills

• R&D experience in dataflow chips or LPU chips.
• Experience in hardware adaptation for large model inference chips.
• Familiar with the fundamentals of AI compilers.
• In‑depth research experience on Groq architecture.