Distributed DL Communication Architect for Scalable AI

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 184,000 - 287,500; Full time

Benefits offered by this job

Equity

Comprehensive benefits package

Job summary

NVIDIA Gruppe in Santa Clara is seeking a Deep Learning Communication Architect to optimize DNN models and enhance communication performance during distributed training. This role requires collaboration with hardware/software teams to implement efficient communication protocols, ensuring seamless operation across large systems.

The ideal candidate holds an advanced degree in a relevant field, has extensive experience with DNNs, and strong programming skills in C++ and Python. NVIDIA offers competitive salaries and an excellent benefits package in a diverse and inclusive environment.

Qualifications

• 6+ years of experience in DNN building, scaling, and optimization.
• Experience with GPU computing and interconnects like NVLink and InfiniBand.
• Proficiency in deep learning training and inference frameworks.

Responsibilities

• Scale DNN models and frameworks for large systems.
• Optimize communication performance for distributed training.
• Develop communication algorithms tailored for deep learning.

Skills

Deep Learning Neural Networks (DNNs)

C++

Python

Data Parallelism

Parallelism Techniques

GPU Computing

Communication Protocols

Education

Ph.D., Master's, or BS in Computer Science, Electrical Engineering, or related field

Tools

PyTorch

TensorRT-LLM

NCCL

MPI

CUDA

OpenCL

Job description

NVIDIA Gruppe in Santa Clara is seeking a Deep Learning Communication Architect to optimize DNN models and enhance communication performance during distributed training. This role requires collaboration with hardware/software teams to implement efficient communication protocols, ensuring seamless operation across large systems.

The ideal candidate holds an advanced degree in a relevant field, has extensive experience with DNNs, and strong programming skills in C++ and Python. NVIDIA offers competitive salaries and an excellent benefits package in a diverse and inclusive environment.