Multi-GPU Deep Learning Communications Engineer

NVIDIA Corporation

Santa Clara (CA)

On-site

USD 124,000 - 242,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

NVIDIA Corporation in Santa Clara seeks a Deep Learning engineer to advance communication technologies in AI stacks, including PyTorch, TRT-LLM, vLLM, and SGLang. You will integrate new communication libraries, optimize multi-GPU workloads, and prototype against AI models at scale.

You’ll work with Python, C++, CUDA, and DSLs like Triton and cuTe, shaping compiler-aware strategies and performance benchmarking across distributed clusters. Collaboration across time zones is essential.

Qualifications

  • Bachelor’s, Master’s, or PhD in Computer Science or related field with software engineering and HPC/AI experience.
  • Experience with Deep Learning Frameworks such as PyTorch, JAX, and inference engines like TRT-LLM, vLLM, SGLang.
  • Rapid prototyping with Python, C++, CUDA or related DSLs (Triton, cuTe).
  • Strong understanding of AI models, parallelism, and compiler technologies (torch.compile).
  • Experience benchmarking AI clusters with profilers (PyTorch profiler, Nsight Systems).

Responsibilities

  • Integrate new communication libraries features in AI frameworks from PoC to production.
  • Analyze AI workloads to identify multi-GPU communication needs and optimize performance.
  • Improve AI compilers to hide communications or enable fusion.
  • Characterize performance on multi-GPU clusters and design elastic, fault-tolerant solutions.
  • Develop custom kernels for compute-communication overlap on NVIDIA platforms.
  • Collaborate with teams across time zones and influence NCCL & NVSHMEM roadmaps.

Skills

PyTorch
JAX
Python
C++
Distributed AI
Performance benchmarking
Compiler concepts

Education

B.S./M.S./PhD in Computer Science or related field

Tools

CUDA
Triton
cuTe
NCCL
NVSHMEM
MPI
Nsight Systems
Torch.compile

Job description

NVIDIA Corporation in Santa Clara seeks a Deep Learning engineer to advance communication technologies in AI stacks, including PyTorch, TRT-LLM, vLLM, and SGLang. You will integrate new communication libraries, optimize multi-GPU workloads, and prototype against AI models at scale.

You’ll work with Python, C++, CUDA, and DSLs like Triton and cuTe, shaping compiler-aware strategies and performance benchmarking across distributed clusters. Collaboration across time zones is essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Framework Communications Engineer — New Grad 2026
AI Framework Communications Engineer — New Grad 2026

2100 NVIDIA USA • Santa Clara (CA)

On-site
USD 124,000 - 242,000
Senior Deep Learning Communication Architect Scalable DL
Senior Deep Learning Communication Architect Scalable DL

NVIDIA Corporation • Seattle (WA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Deep Learning Framework Communications Engineer New Grad
Deep Learning Framework Communications Engineer New Grad

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 124,000 - 242,000
Deep Learning Framework Communications Engineer - New College Grad 2026
Deep Learning Framework Communications Engineer - New College Grad 2026

2100 NVIDIA USA • Santa Clara (CA)

On-site
USD 124,000 - 242,000
DL Communication Architect — Scalable AI Systems + Equity
DL Communication Architect — Scalable AI Systems + Equity

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior Software Engineer, GPU HPC & AI Communications
Senior Software Engineer, GPU HPC & AI Communications

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits package
Senior Deep Learning Framework Communications Engineer
Senior Deep Learning Framework Communications Engineer

NVIDIA Corporation • Westford (MA)

On-site
USD 152,000 - 241,500
Equity
Benefits
Senior Deep Learning Framework Communications Engineer
Senior Deep Learning Framework Communications Engineer

NVIDIA Corporation • Austin (TX)

On-site
USD 152,000 - 241,500
Principal Deep Learning Communication Architect
Principal Deep Learning Communication Architect

NVIDIA Corporation • Austin (TX)

On-site
USD 272,000 - 431,250
Senior Deep Learning Communication Architect
Senior Deep Learning Communication Architect

NVIDIA Corporation • Redmond (WA)

On-site
USD 184,000 - 357,000
Equity
Benefits package