Senior AI Systems & Networking Architect (Remote)

NVIDIA Corporation; Santa Clara (CA); Remote; USD 224,000 - 431,000; Full time

Benefits offered by this job

Equity

Comprehensive benefits

Job summary

NVIDIA Corporation is seeking a Senior Software Architect for AI Systems and Networking. The role focuses on building high-performance communication and memory management libraries for distributed AI, coordinating hardware-software co-optimization across GPUs, DPUs, NICs, and interconnects, and pushing data movement efficiency across GPU memory, DRAM, NVMe, and fabrics.

You will contribute to AI serving stacks, mentor engineers, review designs, and prototype new approaches to validate ideas in a

Qualifications

• 12+ years in systems software and/or networking with ownership of complex projects.
• MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or related field.
• Solid understanding of high-performance networking: InfiniBand, RoCE, RDMA, NVLink, GPUDirect.
• Strong C/C++/Rust systems programming with performance profiling and low-level debugging.
• Understanding of ML systems concepts—transformer architectures, KV cache mechanics, model parallelism, or distributed training/inference patterns.

Responsibilities

• Architecting and implementing high-performance communication and memory management libraries for distributed AI.
• Driving hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects.
• Profiling and optimizing data movement across GPU memory, system DRAM, NVMe, and network fabrics.
• Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM.

Skills

High-performance networking

C/C++/Rust

Performance profiling

Low-level debugging

ML systems concepts

Education

MS/PhD or equivalent

Tools

InfiniBand

RoCE

RDMA

GPUDirect

NVLink

Job description

NVIDIA Corporation is seeking a Senior Software Architect for AI Systems and Networking. The role focuses on building high-performance communication and memory management libraries for distributed AI, coordinating hardware-software co-optimization across GPUs, DPUs, NICs, and interconnects, and pushing data movement efficiency across GPU memory, DRAM, NVMe, and fabrics.

You will contribute to AI serving stacks, mentor engineers, review designs, and prototype new approaches to validate ideas in a