DL Communication Architect — Scalable AI Systems + Equity

NVIDIA Corporation

Santa Clara (CA)

On-site

USD 184,000 - 357,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

NVIDIA Corporation is seeking a Deep Learning Communication Architect in Santa Clara, CA. You will scale DNN models and distributed training frameworks across large clusters, focusing on optimizing data transfer and latency while aligning with high-speed interconnects like NVLink and InfiniBand.

You will design efficient communication protocols, evaluate new technologies, and collaborate across hardware and software teams to deploy effective strategies for modern DL workloads.

Qualifications

  • PhD, Masters, or BS in CS/EE/CSEE or closely related field or equivalent experience.
  • 6+ years building DNNs, scaling DNNs, or related training/inference workloads.
  • Experience evaluating and optimizing LLM training and inference on cutting-edge hardware.
  • Strong understanding of data, pipeline, tensor, expert, and FSDP parallelism.
  • Familiarity with serving architectures and inference servers (e.g., Dynamo, Triton).
  • Proficiency in C++ and Python development for DNN frameworks.

Responsibilities

  • Scale DNN models and training/inference frameworks across large clusters.
  • Optimize communication performance and reduce bottlenecks in distributed training.
  • Design efficient communication protocols for deep learning workloads.
  • Collaborate with hardware/software teams on high-speed interconnects and libraries.
  • Explore new communication technologies to improve performance and scalability.
  • Build proofs-of-concept, run experiments, and validate new strategies.

Skills

C++ & Python
Distributed training
LLM optimization
Parallelism techniques
DNN training & inference

Education

PhD / Masters / BS in CS or EE or related field

Tools

PyTorch
TensorRT-LLM
vLLM
SGLang
CUDA
OpenCL
MPI/NCCL/UCX/NVSHMEM

Job description

NVIDIA Corporation is seeking a Deep Learning Communication Architect in Santa Clara, CA. You will scale DNN models and distributed training frameworks across large clusters, focusing on optimizing data transfer and latency while aligning with high-speed interconnects like NVLink and InfiniBand.

You will design efficient communication protocols, evaluate new technologies, and collaborate across hardware and software teams to deploy effective strategies for modern DL workloads.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Deep Learning Communication Architect Scalable DL
Senior Deep Learning Communication Architect Scalable DL

NVIDIA Corporation • Seattle (WA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Deep Learning Communications Architect — Equity Options
Senior Deep Learning Communications Architect — Equity Options

NVIDIA Corporation • Redmond (WA)

On-site
USD 184,000 - 357,000
Equity
Benefits package
Senior Deep Learning Communication Architect
Senior Deep Learning Communication Architect

NVIDIA Corporation • Redmond (WA)

On-site
USD 184,000 - 357,000
Equity
Benefits package
Multi-GPU Deep Learning Communications Engineer
Multi-GPU Deep Learning Communications Engineer

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 124,000 - 242,000
Senior Deep Learning Communication Architect
Senior Deep Learning Communication Architect

NVIDIA Corporation • Seattle (WA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Deep Learning Communication Architect
Senior Deep Learning Communication Architect

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior AI Communication Systems Architect
Senior AI Communication Systems Architect

NVIDIA Corporation • United States

On-site
USD 272,000 - 431,000
Equity
Benefits package
Principal AI Networking Architect — Equity & Scale
Principal AI Networking Architect — Equity & Scale

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 272,000 - 431,000
Senior AI Communication Architect for Scalable HPC
Senior AI Communication Architect for Scalable HPC

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 272,000 - 431,000
Equity
Benefits
Principal Deep Learning Communication Architect
Principal Deep Learning Communication Architect

NVIDIA Corporation • Austin (TX)

On-site
USD 272,000 - 431,250