GPU Capacity Operations Lead

AI Chopping Block; San Francisco, Northern (CA, KY); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Competitive compensation and equity

Medical, dental, and vision insurance

Flexible PTO including Winter Break

Paid parental leave

Fertility and family-building stipend

Company-facilitated 401(k)

Exposure to ML startups and learning

Job summary

Baseten is seeking a hands-on Operations Manager to own the operational and analytical supply side of our GPU fleet, ensuring maximum healthy GPUs across neocloud and bare metal environments. This role emphasizes process, metrics, reporting, vendor coordination, and cross-functional alignment, with no people management responsibilities.

You will drive supplier performance, maintain live capacity reconciliations, and push for remediation plans that minimize downtime while sustaining peak compute

Qualifications

• 5 to 10+ years within infrastructure focusing on maximize compute capacity.
• Direct experience managing GPU, server, or data center hardware supplier relationships.
• Highly analytical; comfortable pulling data and building reports.
• Comfortable with ambiguity and solving undefined problems.
• Strong cross-functional collaboration with finance, infrastructure/engineering, legal and security.

Responsibilities

• Drive suppliers to keep the maximum amount of the GPU fleet online and healthy.
• Maintain a live reconciliation of contracted vs. provisioned vs. healthy vs. utilized capacity, broken out by supplier and by cluster maximizing the number of healthy GPUs.
• Owner of replacement SLAs, MTTR, and RMA cycle times for every in-scope supplier.
• Monitor SLAs, credit claims, and remediation plans when suppliers fall short.
• Coordinate internal communications to keep Baseten stakeholders informed about maintenance affecting availability.

Skills

Infrastructure management

GPU compute knowledge

Data center operations

Analytical reporting

Cross-functional collaboration

Job description

Baseten is seeking a hands-on Operations Manager to own the operational and analytical supply side of our GPU fleet, ensuring maximum healthy GPUs across neocloud and bare metal environments. This role emphasizes process, metrics, reporting, vendor coordination, and cross-functional alignment, with no people management responsibilities.

You will drive supplier performance, maintain live capacity reconciliations, and push for remediation plans that minimize downtime while sustaining peak compute