Member of Technical Staff - GPU Infrastructure

Hyperbolic; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Hyperbolic is seeking a very senior Infrastructure Engineer to design and scale a GPU Cloud Marketplace. You will build a multi-tenant provisioning and virtualization solution, transforming raw GPUs into a programmable pool for thousands of AI developers and researchers.

Work at the cutting edge of cloud infrastructure to deliver substantial cost savings compared to traditional providers. Deep expertise in bare-metal provisioning, GPU scheduling, and distributed systems is required, along with

Qualifications

• Experience with bare-metal provisioning and lifecycle management, including IPMI/Redfish and automated OS deployment workflows.
• Expertise in GPU scheduling, memory management, topology-aware placement for multi-GPU jobs, and fragmentation minimization.

Responsibilities

• Build and scale Hyperbolic's GPU Cloud Marketplace with multi-tenant provisioning and virtualization.
• Create the core orchestration layer to transform raw GPUs into a programmable, orchestrated pool for thousands of developers.
• Develop infrastructure with cost-saving goals and strong reliability in production environments.

Skills

Bare-metal provisioning

GPU scheduling

Terraform

Pulumi

CI/CD for infra

Observability

Storage for AI/ML

CUDA / GPU compute

Vendor collaboration

Distributed systems

Tools

Terraform

Pulumi

IPMI

Redfish

Job description

Who We Are

Hyperbolic Labs is on a mission to democratize AI by breaking down the barriers to computing power with our Open-Access AI Cloud. By making better use of idle computing resources across the globe, we offer an innovative GPU marketplace and AI inference service that promise affordability and accessibility for all. As pioneers at the intersection of AI and open-source technology, we believe in an open future where AI innovation is limited only by imagination, not by access to resources. We're looking for forward-thinking individuals who share our passion for making AI universally accessible, secure, and affordable. Join us in building a platform that empowers innovators everywhere to turn their visionary AI projects into reality.

Who We Are

Hyperbolic Labs is on a mission to democratize AI by breaking down the barriers to computing power with our Open-Access AI Cloud. By making better use of idle computing resources across the globe, we offer an innovative GPU marketplace and AI inference service that promise affordability and accessibility for all. As pioneers at the intersection of AI and open-source technology, we believe in an open future where AI innovation is limited only by imagination, not by access to resources. We're looking for forward-thinking individuals who share our passion for making AI universally accessible, secure, and affordable. Join us in building a platform that empowers innovators everywhere to turn their visionary AI projects into reality.

About The Role

We're seeking a very senior Infrastructure Engineer to help build and scale Hyperbolic's GPU Cloud Marketplace, by building a multi-tenancy provisioning and virtualization solution. This is a foundational role where you'll be responsible for transforming raw GPUs from diverse global suppliers into a programmable, orchestrated pool that serves thousands of AI developers and researchers. You'll work at the cutting edge of cloud infrastructure, building the core orchestration layer that enables our platform to deliver up to 75% cost savings compared to traditional cloud providers.

Who You Are

• Deep understanding of bare-metal provisioning and lifecycle management, including IPMI/Redfish, BMC-based remote management, PXE boot, and automated OS deployment workflows
• Deep understanding of GPU scheduling and orchestration, including GPU type awareness, memory management, topology considerations, placement strategies for multi-GPU jobs, and fragmentation minimization
• Strong infrastructure and DevOps engineering skills with proficiency in Terraform or Pulumi, CI/CD for infrastructure, secrets management, configuration management, and observability stack implementation
• Experience with storage and data infrastructure for AI/ML workloads, including object storage, high-IOPS block storage, and distributed file systems for training data and checkpoints
• Proficiency with API design and cloud-init for automated provisioning and configuration
• Solid understanding of GPU architecture, CUDA, and GPU compute optimization
• Highly collaborative team player with excellent communication skills across technical and non-technical stakeholders
• Proven ability to work effectively with hardware vendors and vendor engineering teams to troubleshoot issues and optimize integrations
• Experience building and scaling cloud infrastructure or distributed systems in production environments

Preferred Qualifications

• Familiarity with high-performance networking technologies such as InfiniBand and RoCE (RDMA over Converged Ethernet)
• Experience with distributed storage systems such as Ceph, Weka, or VAST Data

Hyperbolic is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.