Senior Infrastructure Engineer, AI GPU Cloud Orchestration

Hyperbolic

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

3 hours ago
Be an early applicant
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Hyperbolic is seeking a very senior Infrastructure Engineer to design and scale a GPU Cloud Marketplace. You will build a multi-tenant provisioning and virtualization solution, transforming raw GPUs into a programmable pool for thousands of AI developers and researchers.

Work at the cutting edge of cloud infrastructure to deliver substantial cost savings compared to traditional providers. Deep expertise in bare-metal provisioning, GPU scheduling, and distributed systems is required, along with

Qualifications

  • Experience with bare-metal provisioning and lifecycle management, including IPMI/Redfish and automated OS deployment workflows.
  • Expertise in GPU scheduling, memory management, topology-aware placement for multi-GPU jobs, and fragmentation minimization.

Responsibilities

  • Build and scale Hyperbolic's GPU Cloud Marketplace with multi-tenant provisioning and virtualization.
  • Create the core orchestration layer to transform raw GPUs into a programmable, orchestrated pool for thousands of developers.
  • Develop infrastructure with cost-saving goals and strong reliability in production environments.

Skills

Bare-metal provisioning
GPU scheduling
Terraform
Pulumi
CI/CD for infra
Observability
Storage for AI/ML
CUDA / GPU compute
Vendor collaboration
Distributed systems

Tools

Terraform
Pulumi
IPMI
Redfish

Job description

Hyperbolic is seeking a very senior Infrastructure Engineer to design and scale a GPU Cloud Marketplace. You will build a multi-tenant provisioning and virtualization solution, transforming raw GPUs into a programmable pool for thousands of AI developers and researchers.

Work at the cutting edge of cloud infrastructure to deliver substantial cost savings compared to traditional providers. Deep expertise in bare-metal provisioning, GPU scheduling, and distributed systems is required, along with

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GPU Cloud Infrastructure Engineer
Senior GPU Cloud Infrastructure Engineer

Hyperbolic • San Francisco (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff - GPU Infrastructure
Member of Technical Staff - GPU Infrastructure

Hyperbolic • San Francisco (CA)

On-site
USD 180,000 - 260,000
Senior AI Infra Architect GPU & Cloud
Senior AI Infra Architect GPU & Cloud

Nvidia Corporation in • Washington

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior GPU Infrastructure Architect
Senior GPU Infrastructure Architect

Primeintellect • San Francisco (CA)

On-site
USD 150,000 - 300,000
Senior AI Cloud Infrastructure Architect | Managed GPU Cloud
Senior AI Cloud Infrastructure Architect | Managed GPU Cloud

Emerald AI • Washington

Hybrid
USD 140,000 - 210,000
Competitive pay + equity
Medical, dental, vision
401(k) matching
+1
Senior GPU Infra Architect for Scalable AI Compute
Senior GPU Infra Architect for Scalable AI Compute

AI Chopping Block • Costa Mesa (CA), Northern (KY)

Hybrid
USD 166,000 - 220,000
VP of AI Cloud Infrastructure & GPU Compute
VP of AI Cloud Infrastructure & GPU Compute

Hyperbolic • San Francisco (CA)

On-site
USD 200,000 - 300,000
Senior GPU Infra Engineer for Scalable AI Platform
Senior GPU Infra Engineer for Scalable AI Platform

Ll Oefentherapie • Nashville (TN)

On-site
USD 130,000 - 190,000
Senior GPU Compute Solutions Architect
Senior GPU Compute Solutions Architect

Computacenter AG & Co. oHG • Northern (KY)

Hybrid
USD 190,000 - 230,000
Platform Engineer - GPU Cloud Control Plane
Platform Engineer - GPU Cloud Control Plane

Hyperbolic • San Francisco (CA)

On-site
USD 140,000 - 210,000