Architect of AI Infrastructure & Workload Orchestration

DataRobot; Boston (MA); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Medical, Dental & Vision Insurance

Flexible Time Off

Paid Holidays

Paid Parental Leave

Global Employee Assistance Program (E"

Job summary

DataRobot in Boston is seeking a Product Manager to own workload orchestration for Kubernetes-based deployments and accelerators, guiding API design, resource models, and scaling strategies across multi-tenant workloads.

You will partner with two engineering pods and product teams, write docs and prototypes to justify roadmap, and help shape a platform layer that enables efficient, reliable AI workloads at scale.

Qualifications

• 6+ years in product management for infrastructure or cloud services.
• 3+ years on Kubernetes-based or distributed systems products.
• Deep technical understanding of GPU/accelerator behavior.
• Experience with API-first product design and prototyping.

Responsibilities

• Own workload and agent runtime orchestration on Kubernetes and accelerators.
• Define deployment API, capacity, scaling, and tenancy.
• Collaborate with two engineering pods and product teams.
• Write docs, API references, and prototypes to justify roadmaps.

Skills

Kubernetes

Platform API design

Multi-tenancy

Technical writing

Cross-functional leadership

Distributed systems

Education

BS or MS in Computer Science or related field

Job description

DataRobot in Boston is seeking a Product Manager to own workload orchestration for Kubernetes-based deployments and accelerators, guiding API design, resource models, and scaling strategies across multi-tenant workloads.

You will partner with two engineering pods and product teams, write docs and prototypes to justify roadmap, and help shape a platform layer that enables efficient, reliable AI workloads at scale.