Senior AI Communication Systems Architect

NVIDIA Corporation; United States; Sur place; USD 272 000 - 431 000; Plein temps

Avantages offerts par ce poste

Equity

Benefits package

Résumé du poste

NVIDIA Corporation is seeking an accomplished architect to define and drive the roadmap for AI communication libraries across its next-generation platforms. You will lead design efforts for scalable primitives and collaboration with application teams to meet trillion-parameter AI demands.

Ideal candidates hold a Ph.D. or MS with 12+ years in HPC or distributed DL, with deep knowledge of 3D parallelism and low-level interconnects, and experience shaping hardware/software co-design for GPUs.

Qualifications

• Ph.D. or MS in Computer Science, Electrical Engineering, or related field (or equivalent experience), with 12+ years of industry HPC/distributed DL.
• Deep understanding of 3D parallelism and ZeRO variants.
• Proficiency with NCCL, UCX, UCC, NVSHMEM, or MPI; experience with RDMA, RoCE, and InfiniBand verbs.
• Advanced knowledge of TensorRT-LLM, vLLM, SGLang, and NVIDIA Dynamo.
• Expert knowledge of NVIDIA GPU memory hierarchy and CUDA programming models.

Responsabilités

• Define the long-term technical roadmap for communication libraries across NVIDIA's platforms.
• Lead the development of next-generation communication primitives and collective algorithms for heterogeneous interconnects.
• Partner with application developers to architect and implement specialized communication primitives for AI and HPC workloads.
• Collaborate with silicon architects and software engineers to influence hardware specifications for future networking.
• Develop high-fidelity analytical models and simulators to predict system behavior under emerging workloads.

Connaissances

Leadership & architecture

Collaboration

Problem solving

Communication

Formation

Ph.D. or MS in Computer Science / Electrical Engineering

Outils

NCCL

UCX

UCC

NVSHMEM

MPI

TensorRT-LLM

vLLM

SGLang

NVIDIA Dynamo

RDMA

RoCE

InfiniBand verbs

Description du poste

NVIDIA Corporation is seeking an accomplished architect to define and drive the roadmap for AI communication libraries across its next-generation platforms. You will lead design efforts for scalable primitives and collaboration with application teams to meet trillion-parameter AI demands.

Ideal candidates hold a Ph.D. or MS with 12+ years in HPC or distributed DL, with deep knowledge of 3D parallelism and low-level interconnects, and experience shaping hardware/software co-design for GPUs.