Senior GPU Sandbox Engineer - Serverless AI Compute

Recruiting From Scratch

San Francisco (CA)

On-site

USD 210,000 - 285,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Competitive base salary plus equity
Location options: San Francisco or CRO
Small, senior engineering team with ó

Job summary

Recruiting From Scratch is helping a rapidly growing infrastructure company in San Francisco hire a Senior Software Engineer to build and operate GPU-backed sandboxes for AI agents. You will own the runtime, virtualization stack, and end-to-end lifecycle from architecture to deployment, with focus on performance and security.

The role demands deep Linux virtualization knowledge (KVM/QEMU, VFIO, IOMMU), strong systems programming in Go, Rust, or C/C++, and hands-on debugging at kernel or driver

Qualifications

  • 5 years of professional systems, infrastructure, virtualization, or platform engineering experience.
  • Deep hands-on experience with Linux virtualization internals, including KVM, QEMU, libvirt, VFIO, and IOMMU.
  • Strong systems programming experience with Go, Rust, C, or C++.
  • Experience debugging Linux systems at or near the kernel, driver, virtualization, or hardware boundary.

Responsibilities

  • Build and productionize the runtime powering GPU-backed sandboxes for AI agents and machine learning workloads.
  • Develop virtualization infrastructure using KVM/QEMU, VFIO passthrough, and IOMMU isolation.
  • Build systems for managing IOMMU groups, PCIe devices, guest drivers, and CUDA stack lifecycles.
  • Optimize GPU sandbox cold-start latency across image caching, VM boot paths, driver initialization, and snapshot restoration.
  • Build GPU-aware scheduling and bin-packing systems that maximize fleet utilization and improve serverless GPU economics.
  • Develop fleet-wide GPU health monitoring, failure detection, and automated remediation infrastructure.

Skills

Linux virtualization
Go
Rust
C/C++

Tools

KVM
QEMU
libvirt
VFIO
IOMMU

Job description

Recruiting From Scratch is helping a rapidly growing infrastructure company in San Francisco hire a Senior Software Engineer to build and operate GPU-backed sandboxes for AI agents. You will own the runtime, virtualization stack, and end-to-end lifecycle from architecture to deployment, with focus on performance and security.

The role demands deep Linux virtualization knowledge (KVM/QEMU, VFIO, IOMMU), strong systems programming in Go, Rust, or C/C++, and hands-on debugging at kernel or driver

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Software Engineer - GPU Sandboxes
Senior Software Engineer - GPU Sandboxes

nineDots.io • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity offered
Relocation considered
Senior Software Engineer, GPU Sandboxes
Senior Software Engineer, GPU Sandboxes

Recruiting From Scratch • San Francisco (CA)

On-site
USD 210,000 - 285,000
Competitive base salary plus equity
Location options: San Francisco or CRO
Small, senior engineering team with ó
Senior GPU Systems Engineer for AI Sandbox Platform
Senior GPU Systems Engineer for AI Sandbox Platform

nineDots.io • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity offered
Relocation considered
Senior Windows Sandbox Engineer for AI Agent Platforms
Senior Windows Sandbox Engineer for AI Agent Platforms

Recruiting From Scratch • San Francisco (CA)

On-site
USD 215,000 - 285,000
Equity
Systems Software Engineer - GPU Cloud & Security
Systems Software Engineer - GPU Cloud & Security

Vast.ai • Los Angeles (CA)

On-site
USD 120,000 - 180,000
Comprehensive health, dental, vision,‑
401(k) with company match
Meaningful equity
+2
Senior GPU & Runtime Sandbox Engineer
Senior GPU & Runtime Sandbox Engineer

Coreweave • Livingston (NJ)

On-site
USD 139,000 - 242,000
Comprehensive benefits program
100% paid medical, dental, and vision insurance
Flexible PTO
+2
Senior Backend Engineer, GPU Cloud Infra & Kubernetes
Senior Backend Engineer, GPU Cloud Infra & Kubernetes

Socket.dev • New York (NY)

Hybrid
USD 180,000 - 250,000
Health insurance
Equity
401(k) matching
+6
Senior GPU Cloud Infrastructure Engineer
Senior GPU Cloud Infrastructure Engineer

Hyperbolic • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior GPU Virtualization Engineer: Kubernetes & Networking
Senior GPU Virtualization Engineer: Kubernetes & Networking

Fal • San Francisco (CA)

On-site
USD 180,000 - 250,000
Health, dental, and vision insurance
Learning and growth opportunities
Regular team events
+1
Senior Linux Systems Engineer - GPU Virtualization
Senior Linux Systems Engineer - GPU Virtualization

Coreweave • Livingston (NJ)

On-site
USD 178,000 - 242,000
Medical, dental, vision insurance
Company-paid Life Insurance
401(k) with employer match
+2