Senior AI Systems Architect: High-Perf Networking & Co-Design

NVIDIA Corporation; United States; On-site; USD 224,000 - 431,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking a Senior Architect to own end-to-end modules and projects in the Networking Systems & Software Architecture group. You will drive technical decisions, prototype novel approaches, and bridge research with production engineering to solve AI infrastructure challenges.

The role focuses on high-performance interconnects, memory management, and integration with AI serving stacks, with opportunities to mentor engineers and contribute to open-source initiatives.

Qualifications

• 12+ years in systems software and/or networking with ownership of complex projects.
• MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or related field.
• Solid understanding of high-performance networking: InfiniBand, RoCE, RDMA, NVLink, GPUDirect.
• Strong C/C++/Rust systems programming with comfort in performance profiling and low-level debugging.
• Understanding of ML systems concepts—transformer architectures, KV cache mechanics, model parallelism, or distributed training/inference patterns.

Responsibilities

• Architect and implement high-performance communication and memory management libraries for distributed AI.
• Drive hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects.
• Profile and optimize data movement across GPU memory, system DRAM, NVMe, and network fabrics.
• Integrate networking capabilities into AI serving stacks (e.g., vLLM, SGLang, TensorRT-LLM).
• Contribute to and maintain open-source projects, mentor engineers, conduct design reviews, and prototype experimental technologies.

Skills

C/C++/Rust

Systems programming

Performance profiling

Low-level debugging

ML systems concepts

Education

MS or PhD in CS/CE/EE

Tools

InfiniBand

RoCE

RDMA

GPUDirect

NVLink

Job description

NVIDIA Corporation is seeking a Senior Architect to own end-to-end modules and projects in the Networking Systems & Software Architecture group. You will drive technical decisions, prototype novel approaches, and bridge research with production engineering to solve AI infrastructure challenges.

The role focuses on high-performance interconnects, memory management, and integration with AI serving stacks, with opportunities to mentor engineers and contribute to open-source initiatives.