Senior Product Manager – GPU & AI Infrastructure

DeepRec.ai; San Francisco (CA); Hybrid; USD 130,000 - 170,000; Full time

Job summary

DeepRec.ai is seeking a Technical Product Manager to own an AI scheduling product within its AI infrastructure portfolio. You will define the multi-year vision, decide what gets built, and work closely with engineers, infrastructure teams and enterprise customers to solve AI workload scheduling at scale.

You’ll lead roadmaps, translate customer needs into actionable decisions, and collaborate with Engineering, Sales and leadership to bring those decisions to life.

Qualifications

• 5+ years of Product Management experience owning infrastructure/platform/developer tooling products.
• Experience with technologies such as Kubernetes, Slurm, OpenStack, VMware or similar.
• Strong understanding of cloud compute infrastructure and how AI/ML workloads run.
• Experience defining multi-year product roadmaps with engineers and technical customers.

Responsibilities

• Own the multi-year product vision and roadmap for an AI scheduling product.
• Translate customer needs into clear product decisions and drive them with engineering, sales and leadership.
• Address challenges around job queuing, GPU resource allocation, and performance as workloads scale.

Skills

Kubernetes

Slurm

OpenStack

VMware

Job description

You’ll own the product that decides where and when AI workloads run.

This is an opportunity to take ownership of an AI Scheduling product at a growing AI infrastructure business. You’ll define the multi-year product vision, decide what gets built and work closely with engineers, infrastructure teams and enterprise customers to solve the challenges of running AI at scale.

The product focuses on some of the biggest challenges in AI infrastructure: how jobs are queued, how expensive GPU resources are allocated, and how performance, latency and reliability are managed as workloads grow.

You’ll have real ownership of the roadmap, translating customer needs into clear product decisions and working closely with Engineering, Sales and leadership to bring those decisions to life.

This could suit you if you’re already a Technical Product Manager working on cloud infrastructure, platforms, developer tooling or cluster management and want to take ownership of a product at the centre of the AI infrastructure market.

You’ll need:

• 5+ years of Product Management experience, including ownership of infrastructure, platform or developer tooling products.
• Experience with technologies such as Kubernetes, Slurm, OpenStack, VMware or similar.
• A good understanding of cloud, compute infrastructure and how AI/ML workloads run.
• Experience defining multi-year product roadmaps and working closely with engineers and technical customers.
• Strong communication skills and the ability to make product decisions in a technically complex environment.

Experience in AI/ML infrastructure, GPU scheduling or MLOps would be particularly relevant.

You’ll be based in the San Francisco Bay Area, working in a hybrid setup, ideally 1–3 days per week in the office, with some flexibility. The role also involves travel between the US and Germany, up to 30% as business needs require.