GPU Fleet Operations Manager

Baseten; San Francisco, Northern (CA, KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Baseten is seeking a hands-on Operations Manager to own the operational and analytical supply side of our GPU fleet. You’ll drive governance for fleet health, lifecycle, and vendor remediation across neocloud and bare metal environments.

In this role you’ll run live reconciliations of contracted, provisioned, healthy, and utilized capacity by supplier and cluster, with a focus on maximizing available GPUs and minimizing downtime. This is an operator role, not a people manager.

Qualifications

• 5 to 10+ years in infrastructure compute lifecycle.
• Direct experience managing GPU, server, or data center supplier relationships.
• Analytical and able to generate insights from data.
• Comfortable with ambiguity and building processes.
• Strong cross-functional collaboration with finance, infrastructure/engineering, legal, and security.

Responsibilities

• Drive suppliers to keep the maximum amount of the GPU fleet online and healthy.
• Maintain a live reconciliation of contracted vs. provisioned vs. healthy vs. utilized capacity, broken out by supplier and by cluster maximizing the number of healthy GPUs.
• Supplier-attributed fleet health accountability: own replacement SLAs, MTTR, and RMA cycle times for every in-scope supplier.
• SLA monitoring, credit claims, and remedy enforcement: track SLA performance against contract terms, file and pursue credit claims, and drive remediation plans when suppliers fall short.
• Drive internal communications where suppliers need to perform maintenance to ensure Baseten stakeholders are aware of activities that impact availability.

Skills

Infra/Compute lifecycle

GPU / data center hardware

Analytical reporting

Cross-functional collaboration

Ambiguity tolerance

Job description

Baseten is seeking a hands-on Operations Manager to own the operational and analytical supply side of our GPU fleet. You’ll drive governance for fleet health, lifecycle, and vendor remediation across neocloud and bare metal environments.

In this role you’ll run live reconciliations of contracted, provisioned, healthy, and utilized capacity by supplier and cluster, with a focus on maximizing available GPUs and minimizing downtime. This is an operator role, not a people manager.