Remote Senior Staff GPU Systems Engineer

Runware

California

Remote

USD 180,000 - 300,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Generous paid time off
Meaningful stock options
Flexible hours
Family leave
Company retreats

Job summary

Runware is seeking a Senior Staff Engineer, Infrastructure Systems, to own the GPU software stack across all nodes. You’ll manage firmware, kernel, NVIDIA driver, CUDA runtime, runtime libraries, and container tooling, ensuring reliable, scalable GPU operations.

You will work with node ops, Managed Kubernetes, inference performance, and Sonic Inference Engine teams. Expect to qualify releases, diagnose failures, and drive fleet-wide health and performance.

Qualifications

  • 12+ years building and operating systems software.
  • 2nd
  • Hands-on knowledge of the NVIDIA software stack: kernel driver, CUDA runtime and libraries, and related tools.
  • 3
  • Record of taking GPU failures to root cause across hardware, firmware, driver, runtime and application.
  • 4
  • Strong Linux internals: kernel, drivers, PCIe, NUMA, containers and perf tooling.
  • 5
  • You write code every day in Python and at least one systems language; CUDA experience preferred.
  • 6
  • Experience running GPUs under Kubernetes and bare metal at scale.
  • 7

Responsibilities

  • Own the GPU software baseline: kernel, NVIDIA driver, firmware, CUDA runtime and libraries, and container toolkit.
  • Qualify every driver and CUDA release; maintain compatibility matrix and prevent regressions.
  • Investigate GPU failures to root cause across hardware, firmware, driver, runtime and application.
  • Build GPU acceptance and diagnostics, burn-in, DCGM, memory tests and real-workload tests.
  • Make GPU health visible and self-healing by collecting telemetry and automating fault paths.
  • Own exposure of GPUs to workloads: container runtime, device plugins, and sharing policies.
  • Bring up new GPU generations and pods with cross-team validation and automation.
  • Characterize hardware with real workloads and feed results to placement and purchasing.
  • Collaborate with NVIDIA and upstream projects; file bugs and contribute fixes.
  • Use AI to accelerate the work with automated triage, test generation and runbook automation.

Skills

GPU software
Python
C/C++
Rust/Go
Linux kernel internals
NVIDIA driver/CUDA stack
Kubernetes/container tech
Root-cause analysis
CUDA debugging

Tools

NVIDIA driver
CUDA
DCGM
Container Toolkit
NCCL
TensorRT
NVML

Job description

Runware is seeking a Senior Staff Engineer, Infrastructure Systems, to own the GPU software stack across all nodes. You’ll manage firmware, kernel, NVIDIA driver, CUDA runtime, runtime libraries, and container tooling, ensuring reliable, scalable GPU operations.

You will work with node ops, Managed Kubernetes, inference performance, and Sonic Inference Engine teams. Expect to qualify releases, diagnose failures, and drive fleet-wide health and performance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GPU Infrastructure Platform Lead
Senior GPU Infrastructure Platform Lead

Runware • United States

On-site
USD 250,000 - 320,000
Senior GPU Infra Engineer — Remote, High-Impact IC
Senior GPU Infra Engineer — Remote, High-Impact IC

Runware • United States

Remote
USD 250,000 - 400,000
Stock options
Remote-first culture
Flexible hours
+1
Senior GPU Infrastructure Architect
Senior GPU Infrastructure Architect

Speedrun Talent Network • California

Remote
USD 180,000 - 240,000
Generous PTO
Stock options
Flexible hours
+2
Senior Systems Engineer: GPU Compute & Workload Infra
Senior Systems Engineer: GPU Compute & Workload Infra

NVIDIA Corporation • California

On-site
USD 184,000 - 357,000
Equity
Comprehensive benefits
Senior GPU Software Engineer — Fault Triage & AI Ops
Senior GPU Software Engineer — Fault Triage & AI Ops

present of AI • California

On-site
USD 180,000 - 240,000
Senior Systems Software Engineer - GPU Infra & DevOps
Senior Systems Software Engineer - GPU Infra & DevOps

NVIDIA Corporation • United States

On-site
USD 224,000 - 357,000
Equity
Benefits
Staff Engineer – GPU Infra & Remote Cluster Systems
Staff Engineer – GPU Infra & Remote Cluster Systems

Perimeter Compute • United States

Remote
USD 120,000 - 180,000
Senior Staff Engineer - Infrastructure Systems
Senior Staff Engineer - Infrastructure Systems

present of AI • California

On-site
USD 180,000 - 240,000
Senior Staff Engineer - Infrastructure Systems
Senior Staff Engineer - Infrastructure Systems

Runware • United States

On-site
USD 250,000 - 320,000
Sr Eng Manager: Containers, Kubernetes & Conf. Computing
Sr Eng Manager: Containers, Kubernetes & Conf. Computing

NVIDIA Corporation • California

On-site
USD 272,000 - 431,000