Senior AI Infra Engineer-Distributed GPU Clusters (Equity)

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 184,000 - 356,500; Full time

Job summary

NVIDIA Gruppe in Santa Clara is seeking a Senior Software Engineer to lead the optimization of distributed training across large-scale GPU platforms. Candidates should have substantial experience in AI applications and technical leadership.

This role involves profiling end-to-end workloads, debugging complex systems, and delivering actionable insights to drive performance improvements. You will also mentor engineers and define standards that enhance engineering practices.

An inclusive work environment ensures diverse perspectives contribute to our pioneering AI solutions.

Qualifications

• 8+ years of experience developing software for large-scale AI or HPC systems.
• Expertise debugging AI applications from the application layer to hardware.
• Deep hands-on experience with NCCL and multi-GPU workloads.

Responsibilities

• Lead validation and debugging of large-scale AI clusters.
• Benchmark AI workloads using PyTorch and NVIDIA AI software.
• Profile workload performance using tools like Nsight Systems.

Skills

Technical leadership

AI applications debugging

Python programming

C/C++ programming

Analytical skills

Education

Bachelor's or Master's in Computer Science or related field

Tools

NVIDIA software stacks

CUDA

NCCL

Job description

NVIDIA Gruppe in Santa Clara is seeking a Senior Software Engineer to lead the optimization of distributed training across large-scale GPU platforms. Candidates should have substantial experience in AI applications and technical leadership.

This role involves profiling end-to-end workloads, debugging complex systems, and delivering actionable insights to drive performance improvements. You will also mentor engineers and define standards that enhance engineering practices.

An inclusive work environment ensures diverse perspectives contribute to our pioneering AI solutions.