Senior GPU Fleet Operations Product Manager

Nscale

New York (NY)

On-site

USD 200,000 - 280,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, dental, vision
Flexible PTO
Retirement plan

Job summary

Nscale is hiring a Senior Technical Product Manager for GPU Infrastructure in New York. You will own the day 0–2+ operational software that runs our global GPU fleet, partnering with Fleet Software, SRE, and Support to ship provisioning, testing, deployment, and lifecycle management.

You will define roadmaps, mentor peers, and drive multi-quarter initiatives that improve availability and time-to-recover. You should have 5–8 years in product management for infrastructure, strong technical

Qualifications

  • 5–8 years of product management experience in software or infrastructure.
  • Experience building products for operators such as SRE/NOC teams.
  • Ability to translate operational problems into shippable product outcomes.

Responsibilities

  • Own the strategy and roadmap for Fleet Operations product area (provisioning, fleet health, incident workflows).
  • Lead cross-sprint initiatives across live GPU clusters with engineering, data centre ops, and support.
  • Translate toil into tooling and platform capabilities.
  • Define metrics for GPU fleet (availability, utilization, MTTR) and drive roadmap.
  • Collaborate with engineering on architecture for bare metal, orchestration, observability, and control planes.
  • Drive postmortems into product commitments and improve reliability.

Skills

Technical product management
Cross-functional leadership
Operational awareness
Infra/scale systems knowledge
Strong communication

Education

CS/Engineering degree
Engineering background

Tools

OpenStack Ironic
MAAS
Tinkerbell
NetBox
Grafana
Prometheus
Datadog

Job description

Nscale is hiring a Senior Technical Product Manager for GPU Infrastructure in New York. You will own the day 0–2+ operational software that runs our global GPU fleet, partnering with Fleet Software, SRE, and Support to ship provisioning, testing, deployment, and lifecycle management.

You will define roadmaps, mentor peers, and drive multi-quarter initiatives that improve availability and time-to-recover. You should have 5–8 years in product management for infrastructure, strong technical

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Technical Product Manager, GPU Fleet Operations
Senior Technical Product Manager, GPU Fleet Operations

Nscale • New York (NY)

On-site
USD 220,000 - 260,000
Medical benefits
Dental benefits
Vision benefits
+3
Senior Observability Product Manager, GPU Fleet
Senior Observability Product Manager, GPU Fleet

Nscale • United States

On-site
USD 200,000 - 280,000
Competitive benefits package
Flexible paid time off
Parental leave
Senior GPU Infrastructure Support Engineer
Senior GPU Infrastructure Support Engineer

Nscale • San Francisco (CA)

On-site
USD 120,000 - 170,000
Equity
Remote-friendly team
Flexible workplace
Senior Technical Product Manager, GPU Infrastructure
Senior Technical Product Manager, GPU Infrastructure

Nscale • New York (NY)

On-site
USD 200,000 - 280,000
Medical, dental, vision
Flexible PTO
Retirement plan
Senior Product Manager, Network
Senior Product Manager, Network

Nscale • New York (NY)

On-site
USD 220,000 - 260,000
Medical benefits
Dental benefits
Vision benefits
+3
Senior GPU Infra Engineer — Remote
Senior GPU Infra Engineer — Remote

Nscale • Seattle (WA)

On-site
USD 120,000 - 170,000
Remote-first culture
Equity plan
Flexible workplace
GPU Infrastructure Engineer
GPU Infrastructure Engineer

Nscale • Houston (TX), San Francisco (CA), Seattle (WA)

On-site
USD 100,000 - 140,000
Principal Product Manager, GPU Hardware & Cloud
Principal Product Manager, GPU Hardware & Cloud

Lambda • San Francisco (CA)

Hybrid
USD 338,000 - 438,000
Health, dental, and vision coverage
Wellness stipend
Commuter stipend
+2
GPU Fleet Health & Capacity Manager
GPU Fleet Health & Capacity Manager

baseten • United States

On-site
USD 130,000 - 170,000
Equity
Medical insurance
Flexible PTO
+3
GPU Fleet Operations Manager
GPU Fleet Operations Manager

Baseten • San Francisco (CA), Northern (KY)

Hybrid
USD 140,000 - 190,000