Remote Senior AI Frameworks Communications Engineer

NVIDIA Corporation; Santa Clara (CA); On-site; USD 160,000 - 280,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking a Senior Deep Learning Framework Communications Engineer in Santa Clara, CA to advance multi-GPU communication in AI stacks including PyTorch, TRT-LLM and JAX.

You will analyze workloads, optimize AI compilers, and collaborate across time zones to shape the NCCL/NVSHMEM roadmap. A strong DL/AI and HPC background is required. This full-time role offers equity and benefits, with remote or hybrid options across the US.

Qualifications

• BS/MS/PhD in CS or related field with 5+ years in software/HPC/AI.
• Experience with PyTorch, JAX, and inference engines such as TRT-LLM, vLLM, SGLang.
• Prototyping with Python, C++, CUDA or Triton/cuTe.
• Understanding AI models, parallelism, and compilers.
• Experience benchmarking AI clusters with profiling tools.

Responsibilities

• Integrate new communication libraries features in AI frameworks from PoC to production.
• Perform deep analysis of AI workloads to identify multi-GPU needs.
• Improve AI compilers to hide communications and enable fusion.
• Characterize performance on multi-GPU clusters and design elastic solutions.
• Contribute to NCCL & NVSHMEM roadmap and collaborate across time zones.

Skills

PyTorch integration

JAX integration

CUDA/C++

Python scripting

Performance profiling

HPC concepts

Education

BS/MS/PhD in CS or related field

Tools

NCCL

NVSHMEM

Job description

NVIDIA Corporation is seeking a Senior Deep Learning Framework Communications Engineer in Santa Clara, CA to advance multi-GPU communication in AI stacks including PyTorch, TRT-LLM and JAX.

You will analyze workloads, optimize AI compilers, and collaborate across time zones to shape the NCCL/NVSHMEM roadmap. A strong DL/AI and HPC background is required. This full-time role offers equity and benefits, with remote or hybrid options across the US.