Lead, AI Infrastructure & Orchestration

DataRobot, Inc.; Washington (District of Columbia); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Medical, Dental & Vision Insurance

Flexible Time Off Program

Paid Holidays

Parental Leave

EAP and more

Job summary

DataRobot in Washington, DC is seeking a Senior Product Manager to own workload orchestration APIs and deployment semantics across Kubernetes-based environments. You will shape the API design, governance, and lifecycle, collaborating with engineering pods to ensure scalable, secure tenancy and reliable operation.

You will drive capacity planning, placement, scaling, and private connectivity while delivering robust API contracts and prototyping critical workflows for customer-facing workloads.

Qualifications

• Experience owning public or platform API contracts and the implications of breaking changes.
• Strong written communication and ability to prototype concepts.
• Experience operating with matrixed engineering teams and no direct reports.

Responsibilities

• Own deployment and workload API, including resource model, lifecycle semantics, versioning, and error behavior.
• Define placement and capacity for workloads across nodes and accelerators with tenancy boundaries and quotas.
• Own scaling signals, cold starts, and cost-latency trade-offs for customer-facing controls.
• Define agent runtime isolation and state survivability across restarts or evictions.
• Oversee traffic routing, ingress, load balancing, and private connectivity for model and agent endpoints.
• Ensure governance, audit trails, and metering for tenancy usage and pricing.
• Maintain reliability through SLOs and error budgets to diagnose issues without escalation.

Skills

Kubernetes API

Multi-tenancy

API product

Technical writing

Prototype development

Cross-team coordination

Education

BS in Computer Science

MS in Computer Science

Tools

Kubernetes

CRDs

RBAC

Device plugins

GPU accelerators

Job description

DataRobot in Washington, DC is seeking a Senior Product Manager to own workload orchestration APIs and deployment semantics across Kubernetes-based environments. You will shape the API design, governance, and lifecycle, collaborating with engineering pods to ensure scalable, secure tenancy and reliable operation.

You will drive capacity planning, placement, scaling, and private connectivity while delivering robust API contracts and prototyping critical workflows for customer-facing workloads.