Senior GPU Infrastructure Architect

Speedrun Talent Network

California

Remote

USD 180,000 - 240,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Generous PTO
Stock options
Flexible hours
Family leave
Company retreats

Job summary

Speedrun Talent Network is seeking a Senior Staff Engineer to own the GPU software stack across Runware nodes, including firmware, kernel, NVIDIA driver, CUDA runtime, and container runtimes. You will ensure seamless GPU operation from driver to inference services, and drive automation for health and fault remediation.

You will work with node operations, Kubernetes, and inference teams to deliver rapid bring-ups of new GPU generations and reliable performance at scale.

Qualifications

  • 12+ years building and operating systems software, with GPU software production experience.
  • Deep NVIDIA software stack knowledge: kernel driver, CUDA runtime/libs, NVML/DCGM, Container Toolkit.
  • Track record solving GPU failures across hardware, firmware, driver, runtime and app.
  • Strong Linux internals: kernel, PCIe, NUMA, IOMMU, containers and perf tooling.
  • You write code daily in Python and at least one systems language (C/C++, Rust or Go).
  • Experience with Kubernetes and bare metal GPU provisioning at scale.
  • Familiar with inference frameworks, memory management and multi-GPU execution.
  • Clear technical writing for design docs, postmortems, and updates.

Responsibilities

  • Own the GPU software baseline: kernel, driver, firmware, CUDA and libraries, tested before rollout across fleet.
  • Qualify every driver and CUDA release, maintain compatibility matrix across GPUs and models.
  • Root cause GPU failures: diagnose Xid errors, memory issues, PCIe/NVLink faults.
  • Build GPU acceptance and diagnostics: burn-in, DCGM tests, and real-workload validation.
  • Make GPU health visible: central telemetry view and automated fault remediation paths.
  • Manage GPU exposure to workloads: container runtime, device plugins, and sharing policies.
  • Bring up new GPU generations with NVLink/NVSwitch validation and automation.
  • Benchmark with real workloads to inform placement, pricing and future purchases.
  • Collaborate with NVIDIA and upstream projects; reproduce bugs and contribute fixes.
  • Leverage AI tools for log triage, test generation, and release qualification.

Skills

GPU software stack
Python
C/C++
Rust
CUDA knowledge
Kubernetes
Linux internals
Root cause analysis
Systems thinking
Technical writing

Job description

Speedrun Talent Network is seeking a Senior Staff Engineer to own the GPU software stack across Runware nodes, including firmware, kernel, NVIDIA driver, CUDA runtime, and container runtimes. You will ensure seamless GPU operation from driver to inference services, and drive automation for health and fault remediation.

You will work with node operations, Kubernetes, and inference teams to deliver rapid bring-ups of new GPU generations and reliable performance at scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GPU Infrastructure Platform Lead
Senior GPU Infrastructure Platform Lead

Runware • United States

On-site
USD 250,000 - 320,000
Remote Senior Staff GPU Systems Engineer
Remote Senior Staff GPU Systems Engineer

Runware • California

Remote
USD 180,000 - 300,000
Generous paid time off
Meaningful stock options
Flexible hours
+2
Senior GPU Infra Engineer — Remote, High-Impact IC
Senior GPU Infra Engineer — Remote, High-Impact IC

Runware • United States

Remote
USD 250,000 - 400,000
Stock options
Remote-first culture
Flexible hours
+1
Senior GPU Software Engineer — Fault Triage & AI Ops
Senior GPU Software Engineer — Fault Triage & AI Ops

present of AI • California

On-site
USD 180,000 - 240,000
Senior Systems Software Engineer - GPU Infra & DevOps
Senior Systems Software Engineer - GPU Infra & DevOps

NVIDIA Corporation • United States

On-site
USD 224,000 - 357,000
Equity
Benefits
Senior Staff Engineer - Infrastructure Systems
Senior Staff Engineer - Infrastructure Systems

present of AI • California

On-site
USD 180,000 - 240,000
Senior GPU Power & Performance Systems Engineer
Senior GPU Power & Performance Systems Engineer

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior Staff Engineer - Infrastructure Systems
Senior Staff Engineer - Infrastructure Systems

Runware • United States

On-site
USD 250,000 - 320,000
Senior GPU Power & Performance Software Engineer
Senior GPU Power & Performance Software Engineer

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 431,000
Senior GPU-Accelerated Kubernetes Runtime Engineer
Senior GPU-Accelerated Kubernetes Runtime Engineer

2100 NVIDIA USA • United States

Remote
USD 184,000 - 350,000