Senior Product Manager — AI Inference Platform

NVIDIA Corporation

Santa Clara (CA)

Hybrid

USD 208,000 - 380,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA Corporation is seeking a Product Manager for Inference Platform to define and drive products enabling large-scale model serving across open source and proprietary models. This role sits at the intersection of AI research, infrastructure engineering, and real user needs.

You will lead API design, capacity and cost management, and collaborate with engineering, research, and user groups to deliver end-to-end product lifecycles.

Qualifications

  • 12+ years of experience delivering complex technical products.
  • Bachelor's degree or higher, or equivalent experience.
  • Strong written and verbal communication to write clear product docs.
  • Ambiguity tolerance and progress without a full playbook.

Responsibilities

  • Define product vision and strategy for inference platform capabilities (APIs, capacity, cost, performance).
  • Translate user needs into clear requirements and roadmaps.
  • Partner with engineering, research, and user groups to drive execution from concept to launch.
  • Own end-to-end product lifecycle for inference-related products and platform investments.
  • Develop understanding of inference ecosystem, model formats, and serving frameworks.
  • Frame problems, identify knowns/unknowns, and propose next steps.
  • Represent user voice and ground decisions in real needs, not assumptions.
  • Track developments across inference landscape and emerging use cases.

Skills

Technical leadership
AI/ML systems
Inference serving frameworks
API design
Open source ecosystems
Strong communication

Education

Bachelor's degree or higher

Tools

TensorRT-LLM

Job description

NVIDIA Corporation is seeking a Product Manager for Inference Platform to define and drive products enabling large-scale model serving across open source and proprietary models. This role sits at the intersection of AI research, infrastructure engineering, and real user needs.

You will lead API design, capacity and cost management, and collaborate with engineering, research, and user groups to deliver end-to-end product lifecycles.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Product Manager, AI Inference Platform
Lead Product Manager, AI Inference Platform

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 208,000 - 328,000
Equity
Benefits
Senior AI Inference Platform Product Manager
Senior AI Inference Platform Product Manager

Nebius Group • Oregon

Hybrid
USD 228,000 - 285,000
Health insurance
401(k) match
Parental leave
+2
Senior Product Manager, Inference Platform
Senior Product Manager, Inference Platform

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 208,000 - 380,000
Equity
Benefits
AI Inference Platform Lead – Equity Eligible
AI Inference Platform Lead – Equity Eligible

NVIDIA Corporation • Washington

On-site
USD 184,000 - 357,000
Equity
Benefits package
Senior Product Manager - AI Platform Inference
Senior Product Manager - AI Platform Inference

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 208,000 - 328,000
Equity
Benefits
Product Manager, AI Inference Platform at Scale
Product Manager, AI Inference Platform at Scale

Black.ai • New York (NY)

On-site
USD 160,000 - 240,000
Equity
Medical, dental, vision insurance (US)
Flexible PTO
+3
AI Inference Product Manager — Serverless & Auto-Scaling
AI Inference Product Manager — Serverless & Auto-Scaling

AIToolboard • Alexandria (VA)

Hybrid
USD 140,000 - 190,000
Engineering Manager, GPU AI Inference at Scale
Engineering Manager, GPU AI Inference at Scale

NVIDIA Corporation • New York (NY)

On-site
USD 184,000 - 357,000
Equity
Benefits
Product Manager, Inference Experience
Product Manager, Inference Experience

present of AI • San Francisco (CA)

On-site
USD 140,000 - 200,000
Senior Product Leader: Data Platforms & AI Infrastructure
Senior Product Leader: Data Platforms & AI Infrastructure

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 240,000 - 380,000