Senior AI System Interconnect Architect

Credo; San Jose (CA); On-site; USD 220,000 - 280,000; Full time

Job summary

Credo is seeking a Principal AI System Architect in San Jose, CA to solve system-level interconnection challenges connecting XPUs into scalable AI infrastructure. You will define how compute elements are wired and orchestrated across nodes and racks to enable efficient large-scale LLM training and inference.

The role requires hands-on NPU hardware experience, with a track record of taking NPU silicon from architecture through bring-up to production.

Qualifications

• Bachelor's degree in Computer Engineering, Electrical Engineering, Computer Science, or related field required.
• Ten years in XPU or AI interconnect system design, architecture and micro architecture working experience.
• Five cycles of complete ASIC tapeouts.
• Strong foundational understanding of computer architecture, including GPU, NPU, and/or CPU design principles; deep, hands-on NPU hardware architecture expertise.
• Familiarity with large language model architectures and distributed training/inference concepts.
• Demonstrated analytical ability with track record of independently studying and synthesizing technical material.
• Strong cross-functional leadership and communication skills, daily experience working with compiler, software, SOC & backend teams.

Responsibilities

• Define the memory and interconnection architecture linking XPUs to memory and across node, rack, and cluster boundaries.
• Solve communication and topology bottlenecks during distributed LLM training and inference.
• Define how XPUs utilize memory and interconnect fabric, ensuring workloads map to the network topology.
• Work with silicon, memory, networking, and software teams to specify interconnect fabric requirements and resolve integration issues.
• Bring hands-on NPU hardware architecture judgment to interconnect and system design decisions.
• Track leading open LLM architectures to anticipate stress on interconnect and system topology.
• Lead and mentor a team of architects focused on system interconnection; present strategy to leadership.

Skills

Cross-functional leadership

Analytical ability

Computer architecture principles

Education

Bachelor's degree in Computer Engineering/EE/CS

Master's degree or PhD in a related field

Tools

NPU hardware development

PCIe / Ethernet / RDMA

NPU tapeout tools

Job description

Credo is seeking a Principal AI System Architect in San Jose, CA to solve system-level interconnection challenges connecting XPUs into scalable AI infrastructure. You will define how compute elements are wired and orchestrated across nodes and racks to enable efficient large-scale LLM training and inference.

The role requires hands-on NPU hardware experience, with a track record of taking NPU silicon from architecture through bring-up to production.