Lead Architect, AI Networking & Distributed GPU Dataflow

NVIDIA; Austin (TX); On-site; USD 272,000 - 431,250; Full time

Job summary

NVIDIA is seeking a senior role to drive the technical vision for distributed AI communication systems. The successful candidate will have over 15 years of systems software or networking experience, focusing on high-performance networking and GPU accelerated systems. Responsibilities include conducting research, integrating networking capabilities into AI stacks, and mentoring engineers. A competitive salary range of $272,000 to $431,250 is offered, alongside equity and benefits, in a diverse work environment.

Qualifications

• 15+ years in systems software and/or networking expertise.
• Deep understanding of computer architecture and OS-level networking.
• Understanding of ML systems concepts and distributed training patterns.

Responsibilities

• Setting the long-term technical vision for distributed AI communication systems.
• Conducting original research on networking solutions.
• Integrating networking capabilities into AI serving stacks.

Skills

High-performance networking (InfiniBand, RoCE, RDMA, NVLink)

Communication libraries (NIXL, NCCL, UCX, MPI, NVSHMEM)

GPU programming (C, C++, Rust, Python)

ML systems concepts (transformer architectures, model parallelism)

Education

MS, PhD or equivalent in Computer Science, Computer Engineering, Electrical Engineering

Job description

NVIDIA is seeking a senior role to drive the technical vision for distributed AI communication systems. The successful candidate will have over 15 years of systems software or networking experience, focusing on high-performance networking and GPU accelerated systems. Responsibilities include conducting research, integrating networking capabilities into AI stacks, and mentoring engineers. A competitive salary range of $272,000 to $431,250 is offered, alongside equity and benefits, in a diverse work environment.