Distinguished Software Architect - Deep Learning and HPC Communications

NVIDIA AI; Santa Clara (CA); On-site; USD 320,000 - 488,750; Full time

Benefits offered by this job

Equity

Inclusive work environment

Job summary

NVIDIA AI is seeking a Distinguished Software Architect to join the GPU Communications Libraries and Networking team. The role involves researching and designing new communication technologies for data center platforms, focusing on optimizing performance in GPU clusters.

The ideal candidate will possess a PhD in Computer Science or a related field, with 15+ years of relevant experience and expertise in high-performance computing, parallel programming, and deep learning.

The position offers a competitive salary and equity, and applications are accepted until June 16, 2026.

Qualifications

• 15+ years of relevant experience in academia or industry.
• Expertise in various communication runtimes (MPI, NCCL, etc.).
• Deep understanding of networking design and performance analysis.

Responsibilities

• Research new communication technologies and design features.
• Propose innovative hardware and software solutions.
• Drive adoption of new technologies across application verticals.

Skills

HPC

Parallel programming models

GPU architecture

C/C++ programming

ML/DL fundamentals

High-performance networking

Education

PhD in Computer Science or related field

Tools

CUDA

TensorFlow

PyTorch

Job description

We are the GPU Communications Libraries and Networking team at NVIDIA. We deliver communication libraries like NCCL, NVSHMEM, and UCX for Deep Learning and HPC. We are looking for a Distinguished Software Architect to help co‑design our next generation data center platforms. Data‑center scale GPU clusters rely on high‑speed interconnects (NVLink, PCIe) and networking (Infiniband, Ethernet). Efficient communication between GPUs directly impacts end‑to‑end application performance.

What You Will Be Doing

• Research new communication technologies (e.g., expand the GPUDirect technology portfolio) and design new features for our communication libraries
• Propose innovative solutions in hardware and software for our next‑gen platforms, co‑designing with GPU, Networking, and SW architects to ensure seamless integration with software stacks
• Inspire changes based on quantitative data from proof‑of‑concepts or detailed technical analysis/modeling
• Drive the adoption of new communication technologies across application verticals
• Keep up with the latest DL research and collaborate with diverse teams, including DL researchers and customers

What We Need To See

• PHD in Computer Science, Computer Engineering, or a related field, or strong equivalent experience; 15+ years of relevant experience in academia or industry
• Expertise in HPC, parallel programming models (MPI, SHMEM), at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC), computer and system architecture, GPU architecture, and CUDA
• Deep understanding of high‑performance networking: Infiniband, Ethernet, network design, topologies, debug, and performance analysis
• Strong knowledge of ML/DL fundamentals and how they tie to communications, parallel algorithms, fault tolerance, resiliency, performance analysis, and optimizations for large‑cluster parallel applications; experience developing applications using DL frameworks (PyTorch, TensorFlow)
• Programming fluency with C or C++ for systems software development
• Flexibility to work and communicate effectively across different HW/SW teams and time zones

Ways To Stand Out From The Crowd

• Industry‑recognized leadership in HPC/DL communications with a history of patents, publications, conference talks, and keynotes relevant to this role
• Influential role in industry standards (e.g., MPI, OpenSHMEM) and open‑source software (e.g., PyTorch, UCX, Open MPI)

Compensation and Benefits

Your base salary range is USD 320,000–488,750, depending on location, experience, and comparable positions. You will also be eligible for equity and benefits.

Applications will be accepted until June 16, 2026.

Equal Opportunity Employer

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. We do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.