Principal PM, AI Infra & Orchestration

DataRobot; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Medical, Dental & Vision Insurance

Flexible Time Off Program

Paid Holidays

Paid Parental Leave

Global Employee Assistance Program (E 

Job summary

DataRobot is seeking a senior product manager to own the workload orchestration layer across Kubernetes and accelerators. You will design the deployment API, define how workloads are placed, and craft scaling signals that balance cost and latency for enterprise customers.

You will lead with a focus on multi-tenant isolation, private connectivity, and robust governance, while collaborating with platform and product teams to deliver scalable AI workloads in production.

Qualifications

• 6+ years in product management for infrastructure or cloud services.
• Deep technical understanding of GPU/accelerator behavior and Kubernetes.
• Experience with multi-tenancy and API contract design.

Responsibilities

• Own deployment and workload API design, lifecycle semantics, and versioning.
• Plan placement and capacity across nodes and accelerators with tenancy in mind.
• Design autoscaling signals and cost-latency trade-offs for customers.
• Define agent runtime isolation, state handling, and restart behavior.
• Manage traffic routing, private connectivity, and tenancy boundaries.
• Oversee governance, audit trails, metering and packaging for tenants.
• Ensure reliability with defined SLOs and error budgets.

Skills

Kubernetes expertise

Distributed systems

API product judgment

Technical writing

Product management

Cross-functional leadership

Matrixed teams

Education

BS or MS in Computer Science or related field

Tools

Kubernetes

Airflow

Temporal

Job description

DataRobot is seeking a senior product manager to own the workload orchestration layer across Kubernetes and accelerators. You will design the deployment API, define how workloads are placed, and craft scaling signals that balance cost and latency for enterprise customers.

You will lead with a focus on multi-tenant isolation, private connectivity, and robust governance, while collaborating with platform and product teams to deliver scalable AI workloads in production.