Senior AI Systems Architect - High-Performance Networking

NVIDIA Corporation; Santa Clara (CA); On-site; USD 224,000 - 431,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Architect in Santa Clara to own end-to-end modules and projects in networking systems and software architecture. You will lead high-performance distributed AI memory and data movement libraries, drive hardware-software co-optimization, and mentor engineers while shaping production-ready solutions.

You will work at the boundary of applied research and production engineering, with opportunities to contribute to open-source projects and influence NVIDIA's interconnect

Qualifications

• 12+ years in systems software and/or networking with ownership of complex projects.
• MS, PhD or equivalent in CS/CE/EE or related field.
• Strong background in high-performance networking: InfiniBand, RoCE, RDMA, NVLink, GPUDirect.
• Proficient in C/C++/Rust with performance profiling and low-level debugging.
• Understanding of ML systems concepts: transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns.

Responsibilities

• Architecting and implementing high-performance communication and memory management libraries for distributed AI.
• Driving hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects.
• Profiling and optimizing data movement across GPU memory, system DRAM, NVMe, and network fabrics.
• Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM.
• Contributing to and maintaining open-source projects, mentoring engineers, conducting design reviews, and prototyping experimental technologies to evaluate their viability.

Skills

C/C++/Rust

Performance profiling

Low-level debugging

Distributed systems

Education

MS/PhD in CS/CE/EE

Tools

InfiniBand

NVLink

GPUDirect RDMA

NVMe-oF

Job description

NVIDIA is seeking a Senior Architect in Santa Clara to own end-to-end modules and projects in networking systems and software architecture. You will lead high-performance distributed AI memory and data movement libraries, drive hardware-software co-optimization, and mentor engineers while shaping production-ready solutions.

You will work at the boundary of applied research and production engineering, with opportunities to contribute to open-source projects and influence NVIDIA's interconnect