Deep Learning Infra Architect for Scalable GPU Training

Nvidia Corporation in

Santa Clara (CA)

On-site

USD 224,000 - 431,000

Full time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA Corporation in Santa Clara, CA, is seeking a Deep Learning Software Infrastructure Engineer to propel its Autonomous Vehicles program. You’ll scale training libraries and infrastructure for end-to-end, multi-thousand GPU training and large datasets, driving faster iterations and safer autonomous models.

Join a collaborative team of researchers and platform engineers to own core components, optimize the training stack, and ensure scalability and developer efficiency across the NVIDIA

Qualifications

  • Requires 12+ years of experience building and scaling high-performance distributed systems, preferably in ML/HPC.
  • Strong knowledge of deep learning frameworks (PyTorch preferred) and large-scale training.
  • Proficiency in Python with production-grade libraries and orchestration tools.
  • Solid systems background including datacenter networking, storage, and schedulers like Slurm and Kubernetes.

Responsibilities

  • Scale deep learning infrastructure libraries and frameworks for training on multi-thousand GPU clusters.
  • Improve efficiency across the training stack: data loaders, distributed training, scheduling, performance monitoring.
  • Build robust training pipelines and libraries for massive datasets and rapid experimentation.
  • Collaborate with researchers, model engineers, and platform teams to enhance efficiency and training availability.
  • Own core infrastructure components such as orchestration libraries and fault-resilient training systems.
  • Partner with leadership to ensure infrastructure scales with growing GPU capacity and data sizes.

Skills

PyTorch
Distributed training
Performance profiling
Python
Datacenter networking
Lustre storage
Slurm
Kubernetes
ML systems engineering
Team collaboration

Education

BS/MS/PhD in Computer Science or related field

Tools

NCCL
RoCE
InfiniBand
Lustre
GPU clusters

Job description

NVIDIA Corporation in Santa Clara, CA, is seeking a Deep Learning Software Infrastructure Engineer to propel its Autonomous Vehicles program. You’ll scale training libraries and infrastructure for end-to-end, multi-thousand GPU training and large datasets, driving faster iterations and safer autonomous models.

Join a collaborative team of researchers and platform engineers to own core components, optimize the training stack, and ensure scalability and developer efficiency across the NVIDIA

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Training Infrastructure Engineer
Senior AI Training Infrastructure Engineer

NVIDIA Corporation • California

On-site
USD 224,000 - 431,000
Senior DL Systems Engineer: Scalable GPU Training (Equity)
Senior DL Systems Engineer: Scalable GPU Training (Equity)

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 431,000
Senior DL Infra Engineer: Scalable GPU AI Training
Senior DL Infra Engineer: Scalable GPU AI Training

NVIDIA Corporation • California

On-site
USD 224,000 - 431,000
Equity
Benefits
Senior Deep Learning Sofware Infrastructure Engineer
Senior Deep Learning Sofware Infrastructure Engineer

NVIDIA Corporation • California

On-site
USD 224,000 - 431,000
Equity
Benefits
Senior Deep Learning Software Infrastructure Engineer
Senior Deep Learning Software Infrastructure Engineer

2100 NVIDIA USA • Santa Clara (CA)

On-site
USD 224,000 - 431,000
Senior Deep Learning Software Infrastructure Engineer
Senior Deep Learning Software Infrastructure Engineer

Nvidia Corporation in • Santa Clara (CA)

On-site
USD 224,000 - 431,000
Equity
Benefits
Senior Deep Learning Software Infrastructure Engineer
Senior Deep Learning Software Infrastructure Engineer

NVIDIA Corporation • California

On-site
USD 224,000 - 431,000
Senior Deep Learning Engineer, End-to-End Autonomous Driving
Senior Deep Learning Engineer, End-to-End Autonomous Driving

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Software Architect, Deep Learning Server Platforms
Senior Software Architect, Deep Learning Server Platforms

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 431,000
Equity
Senior AI-Infra Architect — Platform & Automation
Senior AI-Infra Architect — Platform & Automation

NVIDIA Corporation • California

On-site
USD 224,000 - 357,000
Equity
Benefits