Senior Software Engineer, GPU HPC & AI Communications

NVIDIA Corporation; Santa Clara (CA); On-site; USD 184,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits package

Job summary

NVIDIA is seeking a highly motivated senior software engineer for our communication libraries and network software team. You will design, implement and maintain optimized runtimes for Deep Learning frameworks and HPC interfaces on GPU clusters.

You will collaborate across multi-national teams, contribute to MPI/OpenSHMEM specs, and evaluate new programming models, with a strong foundation in C/C++, Linux, and parallel programming.

Qualifications

• MS/PhD in CS/CE or equivalent experience.
• 5+ years of relevant experience.
• Excellent C/C++ programming and debugging skills.
• Strong experience with Linux.
• Expert understanding of computer system architecture and operating systems.
• Experience with parallel programming interfaces and communication runtimes.

Responsibilities

• Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks and HPC programming interfaces on GPU clusters.
• Participating in and contributing to parallel programming interface specifications like MPI/OpenSHMEM.
• Design, implement and maintain system software that enables interactions among GPUs and interactions between GPUs and other system components.
• Creating proof-of-concepts to evaluate and motivate extensions in programming models, new designs in runtimes and new features in hardware.

Skills

C/C++

Linux

Parallel programming

MPI/OpenSHMEM

CUDA

GPGPU

Education

MS/PhD in CS/CE or equivalent

Tools

NCCL

UCX

CUDA

InfiniBand

Job description

NVIDIA is seeking a highly motivated senior software engineer for our communication libraries and network software team. You will design, implement and maintain optimized runtimes for Deep Learning frameworks and HPC interfaces on GPU clusters.

You will collaborate across multi-national teams, contribute to MPI/OpenSHMEM specs, and evaluate new programming models, with a strong foundation in C/C++, Linux, and parallel programming.