Senior Product Manager - AI Inference Platform

NVIDIA Corporation; Santa Clara (CA); On-site; USD 168,000 - 328,000; Full time

Benefits offered by this job

Equity and benefits

Job summary

NVIDIA is seeking a Senior Product Manager for AI Platform Inference to lead the development of tools, SDKs, and libraries enabling developers to thrive on NVIDIA GPUs. You will shape product strategy, roadmaps, and go-to-market plans while collaborating with internal and external developers to optimize inference workloads.

The role requires deep knowledge of GenAI concepts, performance optimization, and a track record in delivering developer-focused products.

Qualifications

• 6+ years in technical product management at a technology company.
• Experience with inference deployment and optimization software.
• Strong communication and interpersonal skills.

Responsibilities

• Create products to help developers build better Inference deployments.
• Develop product strategy, roadmaps, and go-to-market plans.
• Collaborate with developers to build roadmaps for model optimization software.
• Work with leadership to align with company strategy.

Skills

Inference deployment

Performance optimization

Strategic product planning

Technical communication

Education

BS or MS in CS/CE or equivalent

Tools

TensorRT-LLM

Triton

vLLM

SGLang

FlashInfer

Dynamo

TorchAO

Job description

NVIDIA is seeking a Senior Product Manager for AI Platform Inference to lead the development of tools, SDKs, and libraries enabling developers to thrive on NVIDIA GPUs. You will shape product strategy, roadmaps, and go-to-market plans while collaborating with internal and external developers to optimize inference workloads.

The role requires deep knowledge of GenAI concepts, performance optimization, and a track record in delivering developer-focused products.