Lead Product Manager, AI Inference Platform

NVIDIA; Santa Clara (CA); On-site; USD 208,000 - 328,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Product Manager for AI Platform Inference to build tools, SDKs, and libraries that enable developers to deploy inference on NVIDIA GPUs. You will craft product strategy, roadmaps, and go-to-market plans while partnering with developers to shape model optimization software.

The role requires strong knowledge of inference deployment and performance optimization, a BS/MS in CS/CE (or equivalent), and 6+ years in technical product management.

Qualifications

• Experience with inference deployment and optimization software (e.g., TensorRT-LLM, Triton, TorchAO).
• Strong understanding of GenAI or ML concepts, especially performance optimization.
• BS or MS in CS/CE or equivalent experience, 6+ years in technical product management.
• Excellent communication and collaboration skills.

Responsibilities

• Create products to help developers build better Inference deployments.
• Develop product strategy, roadmaps, and go-to-market plans.
• Collaborate with developers to build roadmaps for model optimization software.
• Work with leadership to align with company strategy.

Skills

Inference deployment

Performance optimization

Product management

Communication

Education

BS/MS in CS/CE or equivalent

Tools

TensorRT-LLM

Triton

TorchAO

SGLang

Job description

NVIDIA is seeking a Senior Product Manager for AI Platform Inference to build tools, SDKs, and libraries that enable developers to deploy inference on NVIDIA GPUs. You will craft product strategy, roadmaps, and go-to-market plans while partnering with developers to shape model optimization software.

The role requires strong knowledge of inference deployment and performance optimization, a BS/MS in CS/CE (or equivalent), and 6+ years in technical product management.