Senior AI Infrastructure Engineer

NVIDIA Corporation

United States

On-site

USD 224,000 - 431,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA in the United States seeks engineers to scale AI infrastructure across datacenter hardware and software. You will contribute to a platform that automates GPU provisioning, configuration, and lifecycle management across cloud providers, building end-to-end automation for data center management and ML systems.

You will work on reliability, performance, and security for distributed systems using Kubernetes/SLURM, Go/Python/Rust, and Linux, with opportunities for equity and comprehensive

Qualifications

  • 12+ years of experience in a similar role working on large-scale production systems
  • BS in Computer Science/Engineering/Physics/Mathematics or equivalent
  • Expert level knowledge of a systems programming language (Go, Python, and/or Rust)
  • Strong background in Linux system administration
  • Deep knowledge of container orchestration platforms such as Kubernetes and/or SLURM
  • Understanding of performance, security, and reliability in complex distributed systems
  • Familiarity with system level architecture, data synchronization, fault tolerance, and state management

Responsibilities

  • Contribute to a comprehensive platform that automates GPU asset provisioning, configuration, and lifecycle management across cloud providers.
  • Build end-to-end automation of data center management, break/fix, and the full span of system upkeep for large-scale Machine Learning systems.
  • Implement monitoring and health management capabilities for reliability, availability, and scalability of GPU assets.
  • Harness data streams from GPU diagnostics to cluster and network telemetry.
  • Build automated test infrastructure used to qualify distributed systems for operation.
  • Partner with NVIDIA engineering teams to ensure seamless integration from hardware to AI training applications

Skills

Go
Python
Rust
Linux administration
Distributed systems

Education

BS in Computer Science/Engineering/Physics/Mathematics or equivalent

Tools

Kubernetes
SLURM

Job description

NVIDIA in the United States seeks engineers to scale AI infrastructure across datacenter hardware and software. You will contribute to a platform that automates GPU provisioning, configuration, and lifecycle management across cloud providers, building end-to-end automation for data center management and ML systems.

You will work on reliability, performance, and security for distributed systems using Kubernetes/SLURM, Go/Python/Rust, and Linux, with opportunities for equity and comprehensive

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer — GPU & Datacenter
Senior AI Infrastructure Engineer — GPU & Datacenter

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 431,000
Equity
Benefits
Senior AI Infra Engineer - Scale GPU Data Centers
Senior AI Infra Engineer - Scale GPU Data Centers

NVIDIA Corporation • Jasper (AL)

On-site
USD 224,000 - 357,000
Senior Software Engineer - Kubernetes AI Infra & Automation
Senior Software Engineer - Kubernetes AI Infra & Automation

NVIDIA Corporation • North Carolina

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior AI Infrastructure & Observability Engineer
Senior AI Infrastructure & Observability Engineer

NVIDIA • Westford (MA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior AI Compute Engineer — AI Infrastructure Lead
Senior AI Compute Engineer — AI Infrastructure Lead

NVIDIA • United States

Remote
USD 148,000 - 236,000
Senior Cloud AI Infrastructure Engineer (Equity)
Senior Cloud AI Infrastructure Engineer (Equity)

NVIDIA Corporation • Town of Montana (WI)

On-site
USD 152,000 - 288,000
Equity
Benefits
AI Infrastructure Engineer: Kubernetes & GPU Clusters
AI Infrastructure Engineer: Kubernetes & GPU Clusters

NVIDIA • United States

Remote
USD 184,000 - 288,000
Senior AI Infrastructure Lead: Scale GPU Clusters
Senior AI Infrastructure Lead: Scale GPU Clusters

Partner Company • United States

Remote
USD 170,000 - 210,000
Senior Storage Engineer for AI Data Infrastructure
Senior Storage Engineer for AI Data Infrastructure

NVIDIA Corporation • United States

Remote
USD 152,000 - 288,000
Senior AI Infrastructure Architect – Public Sector
Senior AI Infrastructure Architect – Public Sector

NVIDIA • Washington

On-site
USD 184,000 - 357,000
Equity compensation
Benefits