Senior Software Architect - Deep Learning and HPC Communications

NVIDIA Corporation; Santa Clara (CA); In loco; USD 184.000 - 357.000; Tempo pieno

Vantaggi offerti da questo lavoro

Equity eligibility

Additional benefits

Descrizione del lavoro

NVIDIA Corporation in Santa Clara, CA, seeks a senior researcher to drive innovations in GPU communication for AI and HPC systems. You will prototype, model, and validate scalable interconnect technologies across CPU/GPU domains.

The role requires advanced C/C++ skills, Linux proficiency, and deep knowledge of parallel runtimes. Collaboration across time zones and teams is expected, with opportunities to influence next‑gen NVIDIA platforms.

Competenze

• MS/PhD in CS/CE or equivalent experience.
• 5+ years of relevant experience.
• Excellent C/C++ programming and debugging skills.
• Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC).
• Deep understanding of operating systems, computer and system architecture.
• Strong grasp of network architecture, topology, algorithms, and communication scaling for AI/HPC workloads.
• Solid experience with Linux.
• Ability to work in a multi-national, multi-time-zone environment.

Mansioni

• Investigate opportunities to improve communication performance by identifying bottlenecks in today’s systems.
• Design and implement new communication technologies to accelerate AI and HPC workloads.
• Explore innovative HW/SW solutions for next-gen platforms as part of co-design with GPU, Networking, and SW architects.
• Build proofs-of-concept, run experiments, and perform quantitative modeling to evaluate new innovations.
• Use simulation to assess performance of large GPU clusters (hundreds to thousands of GPUs).

Conoscenze

C/C++ programming

MPI/SHMEM

OpenSHMEM

NCCL/NVSHMEM

UCX/UCC

Linux

OS concepts

Formazione

MS/PhD in CS/CE

Strumenti

CUDA

NVIDIA GPUs

InfiniBand

RoCE

NVLink

PyTorch

TensorFlow

Descrizione del lavoro

What you will be doing

• Investigate opportunities to improve communication performance by identifying bottlenecks in today’s systems.
• Design and implement new communication technologies to accelerate AI and HPC workloads.
• Explore innovative solutions in HW and SW for next‑generation platforms as part of co‑design efforts involving GPU, Networking, and SW architects.
• Build proofs‑of‑concept, conduct experiments, and perform quantitative modeling to evaluate and drive new innovations.
• Use simulation to explore performance of large GPU clusters (hundreds to thousands of GPUs).

What we need to see

• M.S./Ph.D. degree in Computer Science, Computer Engineering, or equivalent experience.
• 5+ years of relevant experience.
• Excellent C/C++ programming and debugging skills.
• Experience with parallel programming models (MPI, SHMEM) and at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC).
• Deep understanding of operating systems, computer and system architecture.
• Strong grasp of network architecture, topology, algorithms, and communication scaling relevant to AI and HPC workloads.
• Solid experience with Linux.
• Ability and flexibility to work and communicate effectively in a multi‑national, multi‑time‑zone corporate environment.

Ways to stand out from the crowd

• Expertise in related technology and passion for the role.
• Experience with CUDA programming and NVIDIA GPUs.
• Knowledge of high‑performance networks like InfiniBand, RoCE, NVLink, etc.
• Experience with Deep Learning Frameworks such as PyTorch, TensorFlow, etc.
• Knowledge of deep learning parallelisms and mapping to the communication subsystem.
• Experience with HPC applications.
• Strong collaborative and interpersonal skills and a proven track record of guiding and influencing within a dynamic and multi‑functional environment.

Benefits

• Base salary range: $184,000 – $287,500 (Level4) and $224,000 – $356,500 (Level5).
• Eligible for equity and additional benefits.

Equal Opportunity Statement

NVIDIA is committed to fostering an inclusive work environment and is proud to be an equal opportunity employer. NVIDIA values diversity in its current and future employees and does not discriminate on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.