Senior Product Manager — AI Inference Platform

NVIDIA Corporation; Santa Clara (CA); Hybrid; USD 208,000 - 380,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Corporation is seeking a Product Manager for Inference Platform to define and drive products enabling large-scale model serving across open source and proprietary models. This role sits at the intersection of AI research, infrastructure engineering, and real user needs.

You will lead API design, capacity and cost management, and collaborate with engineering, research, and user groups to deliver end-to-end product lifecycles.

Qualifications

• 12+ years of experience delivering complex technical products.
• Bachelor's degree or higher, or equivalent experience.
• Strong written and verbal communication to write clear product docs.
• Ambiguity tolerance and progress without a full playbook.

Responsibilities

• Define product vision and strategy for inference platform capabilities (APIs, capacity, cost, performance).
• Translate user needs into clear requirements and roadmaps.
• Partner with engineering, research, and user groups to drive execution from concept to launch.
• Own end-to-end product lifecycle for inference-related products and platform investments.
• Develop understanding of inference ecosystem, model formats, and serving frameworks.
• Frame problems, identify knowns/unknowns, and propose next steps.
• Represent user voice and ground decisions in real needs, not assumptions.
• Track developments across inference landscape and emerging use cases.

Skills

Technical leadership

AI/ML systems

Inference serving frameworks

API design

Open source ecosystems

Strong communication

Education

Bachelor's degree or higher

Tools

TensorRT-LLM

Job description

NVIDIA Corporation is seeking a Product Manager for Inference Platform to define and drive products enabling large-scale model serving across open source and proprietary models. This role sits at the intersection of AI research, infrastructure engineering, and real user needs.

You will lead API design, capacity and cost management, and collaborate with engineering, research, and user groups to deliver end-to-end product lifecycles.