Senior AI Infra Engineer — Distributed Training & Inference

NVIDIA Corporation

Santa Clara (CA)

On-site

USD 184,000 - 356,500

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Comprehensive benefits package

Job summary

NVIDIA is looking for a Senior Software Engineer in Santa Clara, California, to lead the benchmarking and optimization of AI workloads across GPU platforms. This engineer will set technical standards, profile performance, and mentor team members. The role requires deep experience in distributed computing, AI applications, and strong programming skills in Python and C/C++.

With a competitive base salary range from $184,000 to $356,500, the position also offers equity and benefits, catering to a diverse and inclusive work environment.

Qualifications

  • 8+ years of experience in software infrastructure for large-scale AI or HPC systems.
  • Hands-on experience with multi-GPU and multi-node workloads.
  • Ability to analyze scaling efficiency for distributed workloads.

Responsibilities

  • Lead bring-up, validation, and debugging of large-scale AI clusters.
  • Profile and optimize end-to-end workload performance.
  • Define and build the resilience and failure-attribution stack.

Skills

Expert-level Python
Expert-level C/C++
Debugging AI applications
Large-scale AI systems
Distributed computing

Education

Bachelor's or Master’s in Computer Science or related

Tools

NCCL
CUDA
PyTorch
TensorRT

Job description

NVIDIA is looking for a Senior Software Engineer in Santa Clara, California, to lead the benchmarking and optimization of AI workloads across GPU platforms. This engineer will set technical standards, profile performance, and mentor team members. The role requires deep experience in distributed computing, AI applications, and strong programming skills in Python and C/C++.

With a competitive base salary range from $184,000 to $356,500, the position also offers equity and benefits, catering to a diverse and inclusive work environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Systems Engineer: Distributed Training
Senior AI Systems Engineer: Distributed Training

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior AI Networking & Performance Engineer
Senior AI Networking & Performance Engineer

NVIDIA Corporation • Colorado

On-site
USD 272,000 - 431,250
Staff Engineer - Training & Inference for Distributed AI
Staff Engineer - Training & Inference for Distributed AI

Boson AI • Santa Clara (CA)

On-site
USD 150,000 - 600,000
Senior Architect, Scaled AI Inference & GPU Acceleration
Senior Architect, Scaled AI Inference & GPU Acceleration

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 320,000 - 489,000
Equity
Benefits package
Senior AI Training Performance Architect | Impact & Equity
Senior AI Training Performance Architect | Impact & Equity

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 356,500
Equity
Benefits
Senior Performance Engineer — Benchmarking & AI
Senior Performance Engineer — Benchmarking & AI

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 136,000 - 213,000
Equity
Benefits
Senior Inference Performance Engineer - GPU & CUDA
Senior Inference Performance Engineer - GPU & CUDA

inference.net • San Francisco (CA)

Hybrid
USD 220,000 - 320,000
Equity in a high-growth startup
Comprehensive benefits
Senior Software Engineer, AI Infra & Kubernetes
Senior Software Engineer, AI Infra & Kubernetes

Thomas To • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior ML Performance Engineer, GPU Training & Inference
Senior ML Performance Engineer, GPU Training & Inference

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 357,000
Equity
Benefits
Senior System Software Engineer — GPU AI Inference (Triton)
Senior System Software Engineer — GPU AI Inference (Triton)

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 241,500
Equity
Benefits