Network Infrastructure Architect

SambaNova

San Jose (CA)

On-site

USD 250,000 - 330,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

95% premium coverage for employee medical insurance
Health Savings Account (HSA) with employer contribution
Subscription to Headspace and Gympass+

Job summary

SambaNova in San Jose, California, is looking for a visionary Network Architect to define the future of hyperscale AI compute platforms. In this critical role, you will architect essential networks for next-generation AI workloads, blending hardware engineering with product strategy.

The ideal candidate will have extensive experience in AI compute architecture and networking, translating customer requirements into high-performance solutions. Competitive compensation includes a base salary range of $250,000—$330,000 USD.

Qualifications

  • 12+ years of experience designing compute infrastructure for hyperscale environments.
  • Deep working knowledge of AI cluster networking and fabric dependencies.
  • Experience with lossless or near-lossless Ethernet designs.

Responsibilities

  • Define and drive the future of hyperscale AI compute platforms.
  • Architect foundational networks powering next-generation AI workloads.
  • Translate complex technical requirements into scalable infrastructure solutions.

Skills

AI compute architecture
High-density server architectures
Network automation
Congestion control
Ethernet designs

Job description

The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale. SambaNova Suite™ is the first full‑stack, generative AI platform, from chip to model, optimized for enterprise and government organizations. Powered by the intelligent SN40L chip, the SambaNova Suite is a fully integrated platform, delivered on‑premises or in the cloud, combined with state‑of‑the‑art open‑source models that can be easily and securely fine‑tuned using customer data for greater accuracy. Once adapted with customer data, customers retain model ownership in perpetuity, so they can turn generative AI into one of their most valuable assets.

About SambaNova Systems

Join the company that's building the future of AI computing. At SambaNova, we are disrupting the AI and high‑performance computing space with our integrated hardware and software platform. Our DataScale systems and SambaFlow software are pushing the boundaries of what's possible with generative AI and large language models. We are a team of passionate innovators tackling some of the world's most challenging computational problems.

The Opportunity

We are seeking a visionary Network Architect to define and drive the future of our hyperscale AI compute platform. In this critical role, you will architect the foundational networks powering next‑generation AI workloads, from RDU‑accelerated servers to global‑scale AI clusters. You will sit at the intersection of hardware engineering, product strategy, and large‑scale deployment, translating complex technical and customer requirements into scalable, cost‑optimized, and high‑performance infrastructure solutions.

Qualifications
  • 12+ years of experience designing, architecting, or productizing compute infrastructure for hyperscale, AI, HPC, cloud, or large‑scale data center environments
  • Deep experience with AI compute platforms, including GPU/accelerator systems, high‑density server architectures, rack‑scale compute, and cluster‑level design considerations
  • Strong understanding of server and rack‑level architecture, including power, thermal, mechanical, serviceability, firmware, and platform integration requirements
  • Experience translating customer, workload, and deployment requirements into compute product requirements, platform roadmaps, technical specifications, and architecture tradeoffs
  • Familiarity with modern AI infrastructure components such as GPU servers, accelerator trays, NVLink/NVSwitch‑class fabrics, PCIe/CXL, high‑speed NICs, DPUs/IPUs, and storage‑attached compute architectures
  • Deep working knowledge of AI cluster networking and fabric dependencies, including InfiniBand, RoCEv2, Ethernet‑based AI fabrics, 400G/800G interconnects, and GPU‑to‑GPU east‑west traffic patterns
  • Experience with lossless or near‑lossless Ethernet designs, including QoS, priority mapping, ECN, PFC, congestion management, buffer tuning, telemetry, and failure‑domain isolation
  • Strong understanding of spine‑leaf network architectures and associated technologies such as VXLAN, EVPN, BGP, MLAG, ECMP, underlay/overlay design, multi‑tenant segmentation, and network automation
  • Ability to design and evaluate solutions across multiple networking platforms and operating models, with a vendor‑agnostic approach to architecture, platform selection, interoperability, and lifecycle strategy
  • Experience comparing and integrating technologies across leading switch, NIC, accelerator, optical, and fabric ecosystems, while avoiding unnecessary vendor lock‑in
  • Familiarity with high‑speed optics and cabling implications for AI clusters, including 400G/800G DR4, FR4, LR4, SR, DAC/AOC, fiber topology, link budgets, and transceiver interoperability
  • Ability to evaluate how network choices impact compute product requirements, including NIC selection, DPU/IPU integration, PCIe lane allocation, rack power/thermal design, cabling density, latency, throughput, resiliency, and serviceability
  • Ability to partner closely with hardware engineering, supply chain, manufacturing, operations, networking, facilities, vendors/OEMs/ODMs, and customer‑facing teams to bring compute platforms from concept through deployment
  • Background supporting large‑scale infrastructure operations, including fleet deployment, platform lifecycle management, reliability, observability, telemetry, automation, and field issue resolution
  • Strong product mindset, with the ability to balance performance, cost, manufacturability, deployment velocity, serviceability, supply availability, power efficiency, ecosystem flexibility, and long‑term scalability
Strong Fit Description

A strong fit would be someone who has sat at the intersection of AI compute architecture, product strategy, and hyperscale deployment — with enough network and fabric depth to understand how InfiniBand, RoCE, congestion control, platform interoperability, and spine‑leaf design choices shape the compute products required for next‑generation AI infrastructure.

Base Salary Range

Base Pay Range: $250,000—$330,000 USD

Benefits Summary For US‑Based, Full‑Time Employment Positions

SambaNova offers a competitive total rewards package, including the base salary, plus equity and benefits. We cover 95% premium coverage for employee medical insurance, and 77% premium coverage for dependents and offer a Health Savings Account (HSA) with employer contribution. We also offer Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans in addition to Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care. Our library of well‑being benefits available to you and your dependents includes a full subscription to Headspace, Gympass+ membership with access to physical gyms, One Medical membership, counseling services with an Employee Assistance Program, and much more.

EEO Policy

SambaNova Systems is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard basis of age (40 and over), color, disability, gender identity, genetic information, marital status, military or veteran status, national origin/ancestry, race, religion, creed, sex (including pregnancy, childbirth, breastfeeding), sexual orientation, and any other applicable status protected by federal, state, or local laws.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Network Architect San Jose, California, United States
Network Architect San Jose, California, United States

SambaNova • San Jose (CA)

On-site
USD 250,000 - 330,000
95% premium coverage for medical insurance
Health Savings Account with employer contribution
Dental and Vision insurance
+2
Network Infrastructure Architect
Network Infrastructure Architect

SambaNovaSystems • San Jose (CA)

On-site
USD 250,000 - 330,000
Network Architect - AI Silicon & Systems
Network Architect - AI Silicon & Systems

External SambaNova Systems • United States

On-site
USD 250,000 - 350,000
Network Architect
Network Architect

Socket.dev • Austin (TX)

On-site
USD 250,000 - 350,000
Headspace
Gympass
One Medical
+1
AI Accelerator System Architect
AI Accelerator System Architect

SambaNova Systems • San Jose (CA)

On-site
USD 250,000 - 350,000
Health insurance
Dental & Vision
Flexible benefits
Software Architect
Software Architect

SambaNova • San Jose (CA)

On-site
USD 245,000 - 325,000
95% premium coverage for employee medical insurance
77% premium coverage for dependents
Health Savings Account (HSA)
+1
Senior Principal Rack System Integration Engineer
Senior Principal Rack System Integration Engineer

SambaNova Systems • San Jose (CA)

On-site
USD 210,000 - 280,000
Health insurance
Equity / stock options
HSA with employer contribution
+1
Forward Deployment Engineer
Forward Deployment Engineer

SambaNova Systems • United States

On-site
USD 138,000 - 170,000
Health insurance
HSA with employer contribution
Gympass+ access
+2
Software Architect
Software Architect

SambaNovaSystems • San Jose (CA)

On-site
USD 245,000 - 325,000
Senior Hardware Engineer - Validation & SI Correlation
Senior Hardware Engineer - Validation & SI Correlation

SambaNova • Palo Alto (CA)

On-site
USD 120,000 - 160,000
Comprehensive medical insurance
Health Savings Account with employer contribution
Gym membership