Senior AI Systems Architect: High-Performance GPU Networking

NVIDIA Corporation; California; On-site; USD 224,000 - 431,000; Full time

Benefits offered by this job

Equity

Benefits package

Job summary

NVIDIA’s Networking Systems & Software Architecture group seeks a Senior Architect to own modules end-to-end, from scoping research questions to shipping production code. The role sits at the boundary of applied research and production engineering.

You will architect high-performance communication libraries, drive hardware-software co-design, and mentor engineers while contributing to open-source projects and evaluating new interconnect approaches.

Qualifications

• 12+ years in systems software and/or networking with ownership of complex projects.
• MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
• Solid understanding of high-performance networking: InfiniBand, RoCE, RDMA, NVLink, GPUDirect.
• Strong C/C++/Rust systems programming with comfort in performance profiling and low-level debugging.
• Understanding of ML systems concepts—transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns.

Responsibilities

• Architecting and implementing high-performance communication and memory management libraries for distributed AI
• Driving hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects
• Profiling and optimizing data movement across GPU memory, system DRAM, NVMe, and network fabrics
• Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM
• Contributing to and maintaining open-source projects, mentoring engineers, conducting design reviews, and prototyping experimental technologies to evaluate their viability

Skills

High-performance networking

C/C++/Rust

Systems programming

Performance profiling

Low-level debugging

Education

MS/PhD or equivalent

Tools

InfiniBand

RoCE

RDMA

NVLink

GPUDirect

Job description

NVIDIA’s Networking Systems & Software Architecture group seeks a Senior Architect to own modules end-to-end, from scoping research questions to shipping production code. The role sits at the boundary of applied research and production engineering.

You will architect high-performance communication libraries, drive hardware-software co-design, and mentor engineers while contributing to open-source projects and evaluating new interconnect approaches.