Senior PM, AI Inference Platform & Tools

NVIDIA Corporation; Santa Clara (CA); On-site; USD 168,000 - 328,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation in Santa Clara, CA is seeking a Senior Product Manager for AI Platform Inference to lead the development of tools, SDKs, and libraries enabling developers to deploy AI inference on NVIDIA GPUs.

The role emphasizes building products, defining roadmaps, and collaborating with developers to optimize model deployment performance, with strong emphasis on GenAI concepts and GPU-aware software delivery.

Qualifications

• Experience with Inference deployment and optimization software.
• Knowledge of GenAI or ML concepts, especially regarding performance optimization.
• BS or MS in Computer Science, Computer Engineering, or equivalent experience, with 6+ years in technical product management.
• Strong communication and interpersonal skills.

Responsibilities

• Create products to help developers build better Inference deployments.
• Develop product strategy, roadmaps, and go-to-market plans.
• Collaborate with internal and external developers to build product roadmaps for model optimization software.
• Work with leadership to align with and drive company strategy.

Skills

PM experience

GenAI knowledge

Communication

Software deployment

Education

BS or MS in CS/CE

Tools

vLLM

SGLang

FlashInfer

TensorRT-LLM

Triton

Dynamo

TorchAO

Job description

NVIDIA Corporation in Santa Clara, CA is seeking a Senior Product Manager for AI Platform Inference to lead the development of tools, SDKs, and libraries enabling developers to deploy AI inference on NVIDIA GPUs.

The role emphasizes building products, defining roadmaps, and collaborating with developers to optimize model deployment performance, with strong emphasis on GenAI concepts and GPU-aware software delivery.