Principal PM, AI Infra & Orchestration

DataRobot

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical, Dental & Vision Insurance
Flexible Time Off Program
Paid Holidays
Paid Parental Leave
Global Employee Assistance Program (E 

Job summary

DataRobot is seeking a senior product manager to own the workload orchestration layer across Kubernetes and accelerators. You will design the deployment API, define how workloads are placed, and craft scaling signals that balance cost and latency for enterprise customers.

You will lead with a focus on multi-tenant isolation, private connectivity, and robust governance, while collaborating with platform and product teams to deliver scalable AI workloads in production.

Qualifications

  • 6+ years in product management for infrastructure or cloud services.
  • Deep technical understanding of GPU/accelerator behavior and Kubernetes.
  • Experience with multi-tenancy and API contract design.

Responsibilities

  • Own deployment and workload API design, lifecycle semantics, and versioning.
  • Plan placement and capacity across nodes and accelerators with tenancy in mind.
  • Design autoscaling signals and cost-latency trade-offs for customers.
  • Define agent runtime isolation, state handling, and restart behavior.
  • Manage traffic routing, private connectivity, and tenancy boundaries.
  • Oversee governance, audit trails, metering and packaging for tenants.
  • Ensure reliability with defined SLOs and error budgets.

Skills

Kubernetes expertise
Distributed systems
API product judgment
Technical writing
Product management
Cross-functional leadership
Matrixed teams

Education

BS or MS in Computer Science or related field

Tools

Kubernetes
Airflow
Temporal

Job description

DataRobot is seeking a senior product manager to own the workload orchestration layer across Kubernetes and accelerators. You will design the deployment API, define how workloads are placed, and craft scaling signals that balance cost and latency for enterprise customers.

You will lead with a focus on multi-tenant isolation, private connectivity, and robust governance, while collaborating with platform and product teams to deliver scalable AI workloads in production.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Product Manager, AI-Driven Orchestration
Senior Product Manager, AI-Driven Orchestration

Within • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Employer-Paid Medical, Dental & Vision
Parental Leave
+5
Senior Product Manager, AI-Driven Orchestration
Senior Product Manager, AI-Driven Orchestration

Klarity • San Francisco (CA)

On-site
USD 200,000 - 280,000
Equity
Employer-Paid Medical, Dental & Vision
Parental Leave
+8
Product Operations Lead: AI-Driven Launch Orchestration
Product Operations Lead: AI-Driven Launch Orchestration

Datadog, Inc. • New York (NY)

Hybrid
USD 90,000 - 140,000
RSUs
ESPP
Professional development
+5
Remote Product Manager — Kubernetes & AI Platform
Remote Product Manager — Kubernetes & AI Platform

Cast AI • United States

Remote
USD 64,000 - 103,000
Remote-friendly
Equity options
Learning budget
+4
Director, AI-Driven Infrastructure Automation
Director, AI-Driven Infrastructure Automation

Perforce • United States

Remote
USD 200,000 - 220,000
Medical insurance
Dental and vision benefits
Retirement benefits
+2
Senior Product Manager - Enterprise AI Platforms
Senior Product Manager - Enterprise AI Platforms

robotsandpencils • United States

Remote
USD 140,000 - 210,000
Director of AI-Driven Infrastructure Platform
Director of AI-Driven Infrastructure Platform

Perforce Software • United States

Remote
USD 200,000 - 220,000
Medical benefits
Dental & Vision
Retirement plan
+3
Director, AI-Driven Infrastructure Product
Director, AI-Driven Infrastructure Product

InforCapital, partnership • United States

Remote
USD 200,000 - 220,000
Medical insurance
Dental insurance
Vision insurance
+4
Staff Platform Engineer: Kubernetes & Scale
Staff Platform Engineer: Kubernetes & Scale

DataRobot • United States

Remote
USD 180,000 - 260,000
Medical, Dental & Vision Insurance
Flexible Time Off
Paid Holidays
+2
Product Ops Engineer: Orchestrate AI Deployments & Data Ops
Product Ops Engineer: Orchestrate AI Deployments & Data Ops

HappyRobot • San Francisco (CA)

On-site
USD 120,000 - 180,000
Healthcare
Dental
Vision
+1