Senior AI Resiliency Engineer — 100k+ GPU Scale, Equity

NVIDIA

Santa Clara (CA)

On-site

USD 184,000 - 287,500

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

NVIDIA is seeking a Senior Software Engineer for AI Resiliency in Santa Clara, California. The role focuses on leading the development of AI software resiliency for advanced AI supercomputers, optimizing reliability features at an unprecedented scale.

Candidates should possess strong skills in C++ and Python, with substantial experience in distributed systems and fault tolerance. The position offers a base salary range of 184,000 USD - 287,500 USD, plus equity and benefits.

NVIDIA is committed to diversity and equal opportunity in its hiring practices. Applications accepted until May 16, 2026.

Qualifications

  • 6+ years of relevant experience.
  • Hands-on experience with CUDA, NCCL, or MPI for GPU-accelerated computing.
  • Experience with large-scale AI clusters or cloud-based AI workloads.

Responsibilities

  • Lead development of AI software resiliency for powerful AI supercomputers.
  • Implement and optimize software features that improve AI system reliability.
  • Develop and implement tests to ensure robustness of resiliency mechanisms.

Skills

Proficiency in C++
Proficiency in Python
Distributed systems concepts
Parallel programming
Fault tolerance in large-scale computing
Excellent problem-solving skills

Education

Bachelor’s, Master’s or PhD in Computer Science, Electrical Engineering, or a related field

Tools

NVIDIA Nsight
gdb
perf
valgrind

Job description

NVIDIA is seeking a Senior Software Engineer for AI Resiliency in Santa Clara, California. The role focuses on leading the development of AI software resiliency for advanced AI supercomputers, optimizing reliability features at an unprecedented scale.

Candidates should possess strong skills in C++ and Python, with substantial experience in distributed systems and fault tolerance. The position offers a base salary range of 184,000 USD - 287,500 USD, plus equity and benefits.

NVIDIA is committed to diversity and equal opportunity in its hiring practices. Applications accepted until May 16, 2026.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Software Engineer, AI Resiliency
Senior Software Engineer, AI Resiliency

NVIDIA • United States

On-site
USD 184,000 - 288,000
Senior AI Resiliency Engineer – Equity Eligible
Senior AI Resiliency Engineer – Equity Eligible

NVIDIA • United States

On-site
USD 184,000 - 288,000
Senior Software Engineer, Resilience Engineering - DGX Cloud
Senior Software Engineer, Resilience Engineering - DGX Cloud

NVIDIA • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity options
Comprehensive benefits
Distinguished Resiliency and Safety Architect, GPU Diagnostics
Distinguished Resiliency and Safety Architect, GPU Diagnostics

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 320,000 - 489,000
Senior AI Infra Engineer-Distributed GPU Clusters (Equity)
Senior AI Infra Engineer-Distributed GPU Clusters (Equity)

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 184,000 - 356,500
Distinguished Resiliency and Safety Architect, GPU Diagnostics
Distinguished Resiliency and Safety Architect, GPU Diagnostics

NVIDIA • Santa Clara (CA)

On-site
USD 320,000 - 489,000
Equity
Benefits
Senior GPU Performance Architect - Scale, Equity Eligible
Senior GPU Performance Architect - Scale, Equity Eligible

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Equity
Benefits
Senior DGX Cloud AI Infrastructure Software Engineer
Senior DGX Cloud AI Infrastructure Software Engineer

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 184,000 - 287,500
Equity options
Comprehensive benefits package
Senior AI Compute Engineer - HPC Infra & Linux
Senior AI Compute Engineer - HPC Infra & Linux

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 148,000 - 288,000
Senior GPU AI Engineer for Finance & HPC — Equity
Senior GPU AI Engineer for Finance & HPC — Equity

NVIDIA • California (MO)

On-site
USD 152,000 - 288,000
Equity
Benefits package