Senior Technical Product Manager, GPU Fleet Operations

Nscale

New York (NY)

On-site

USD 220,000 - 260,000

Full time

6 days ago
Be an early applicant
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical benefits
Dental benefits
Vision benefits
Flexible PTO
Parental leave
Retirement plan

Job summary

Nscale is building a vertically integrated GenAI cloud platform, and this Senior Technical Product Manager for Fleet Operations leads the day 0–2+ software that runs the global GPU fleet. You’ll partner with Fleet Software, SRE, data centre operations, and Support to turn operational pain into durable product outcomes and drive multi‑quarter initiatives that improve availability and time‑to-recover.

We value ownership, relentless innovation, and a bias for action.

Qualifications

  • 5–8 years of product management in software/tech infrastructure
  • Ability to discuss architecture, trade-offs, and feasibility with engineers
  • Experience building products for operators (SRE/NOC) and improving reliability

Responsibilities

  • Own strategy and roadmap for Fleet Operations product area.
  • Lead multi-sprint, cross-functional initiatives across GPU clusters.
  • Translate operational pain into tooling, automation, and platform capabilities.
  • Define metrics for GPU fleet availability, utilisation, MTTR, and time-to-bring-up.
  • Partner with engineering on architecture and control planes.
  • Drive incident reviews and postmortems into product commitments.
  • Mentor junior product managers and raise PRD quality.

Skills

Product management
Infrastructure products
Large-scale systems
Cross-functional leadership
SRE collaboration

Education

Degree in CS/Engineering

Tools

Grafana
Prometheus
Datadog

Job description

Nscale is building a vertically integrated GenAI cloud platform, and this Senior Technical Product Manager for Fleet Operations leads the day 0–2+ software that runs the global GPU fleet. You’ll partner with Fleet Software, SRE, data centre operations, and Support to turn operational pain into durable product outcomes and drive multi‑quarter initiatives that improve availability and time‑to-recover.

We value ownership, relentless innovation, and a bias for action.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GPU Fleet Operations Product Manager
Senior GPU Fleet Operations Product Manager

Nscale • New York (NY)

On-site
USD 200,000 - 280,000
Medical, dental, vision
Flexible PTO
Retirement plan
Senior Observability Product Manager, GPU Fleet
Senior Observability Product Manager, GPU Fleet

Nscale • United States

On-site
USD 200,000 - 280,000
Competitive benefits package
Flexible paid time off
Parental leave
Senior Technical Product Manager, GPU Infrastructure
Senior Technical Product Manager, GPU Infrastructure

Nscale • New York (NY)

On-site
USD 200,000 - 280,000
Medical, dental, vision
Flexible PTO
Retirement plan
Senior Product Manager, Network
Senior Product Manager, Network

Nscale • New York (NY)

On-site
USD 220,000 - 260,000
Medical benefits
Dental benefits
Vision benefits
+3
GPU Fleet Health & Capacity Manager
GPU Fleet Health & Capacity Manager

baseten • United States

On-site
USD 130,000 - 170,000
Equity
Medical insurance
Flexible PTO
+3
GPU Fleet Operations Lead | Capacity & Supplier Reliability
GPU Fleet Operations Lead | Capacity & Supplier Reliability

Triwill Group • San Francisco (CA), Northern (KY)

Hybrid
USD 170,000 - 250,000
Equity
Medical coverage
Flexible PTO
+2
Senior GPU Infrastructure Support Engineer
Senior GPU Infrastructure Support Engineer

Nscale • San Francisco (CA)

On-site
USD 120,000 - 170,000
Equity
Remote-friendly team
Flexible workplace
GPU Infrastructure Engineer
GPU Infrastructure Engineer

Nscale • Houston (TX), San Francisco (CA), Seattle (WA)

On-site
USD 100,000 - 140,000
Principal Product Manager, GPU Hardware & Cloud
Principal Product Manager, GPU Hardware & Cloud

Lambda • San Francisco (CA)

Hybrid
USD 338,000 - 438,000
Health, dental, and vision coverage
Wellness stipend
Commuter stipend
+2
GPU Fleet Operations Manager
GPU Fleet Operations Manager

Baseten • San Francisco (CA), Northern (KY)

Hybrid
USD 140,000 - 190,000