Senior Product Manager, Switchyard

NVIDIA; Santa Clara (CA); On-site; USD 168,000 - 259,000; Full time

Benefits offered by this job

Equity

Benefits package

Job summary

NVIDIA is seeking a Senior Product Manager to lead Switchyard, our adaptive inference runtime for models. You will drive product strategy, work with engineering and researchers, and shape the developer experience for flexible model routing and inference.

You will partner with researchers and GTM teams to translate advances into practical features, improve SDK coverage, and guide production deployments, ensuring scalable developer adoption across the ecosystem.

Qualifications

• BS/MS in CS/Engineering or related field, or equivalent experience.
• 8+ years of product management for developer/infrastructure products.
• Experience scaling developer products via partnerships and integrations.
• Proficiency in LLM inference, routing, and developer APIs.

Responsibilities

• Define Switchyard product strategy and roadmap with engineering.
• Collaborate with agent harness builders, inference gateways, and model serving systems.
• Define developer experience and product interfaces for adaptive inference.
• Translate research into usable features with cost/quality tradeoffs.
• Improve reliability, usability, and SDK coverage for production deployments.
• Lead go-to-market coordination with marketing and partners.
• Develop messaging for model routing and adaptive inference.
• Own success metrics and outcomes across teams.
• Coordinate across adjacent teams for joint product outcomes.

Skills

LLM inference

model routing

developer APIs

stakeholder management

Education

CS/Engineering degree

Job description

NVIDIA needs a Senior Product Manager to lead Switchyard, our adaptive inference runtime for systems of models. We build Switchyard to help agentic applications choose among models, providers, tools, reasoning strategies, and runtime configurations to improve task-level quality, cost, latency, and policy compliance without requiring teams to rewrite their agents. You will turn a fast-moving research agenda and a growing partner ecosystem into open source tools that impact model routing and adaptive inference across the industry.

What you’ll be doing:

• Drive Switchyard’s product strategy and roadmap. Set priorities, quality bars, and clear product outcomes together with Engineering.
• Work directly with agent harness builders, inference gateways, model serving systems, and other partners to make integrations successful and turn market feedback into stronger product capabilities.
• Define the developer experience and product interfaces for adaptive inference.
• Partner with Research to translate advances in areas like cost and quality prediction, constrained optimization, and budget allocation into usable products and features.
• Partner with Engineering to improve reliability, usability, documentation, SDK coverage, and the customization path for production deployments.
• Build the adoption motion with Product Marketing, Solution Architects, and GTM teams. Identify qualified workloads, guide partner pilots, and build repeatable deployment playbooks.
• Establish the messaging and narrative for how our teams talk about model routing and adaptive inference, working together with Product Marketing.
• Define and inspect the evidence for success. Own the outcomes.
• Coordinate across adjacent teams to build compelling joint product outcomes..

What we need to see:

• Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related field, or equivalent experience.
• 8+ years of product management or closely related experience building technical products for developers, infrastructure teams, or AI practitioners.
• A record of scaling developer or infrastructure products through a partnership motion and integrations, not only through a single first-party application.
• Technical proficiency in LLM inference, model routing, agent runtimes, and developer APIs. Able to reason clearly about quality/cost/latency tradeoffs.
• Ability to engage mature customers and partners independently, uncover real production constraints, and guide GTM teams through complex technical adoption.
• Positive relationships with Engineering and Research teams. Ask sharp questions, convert uncertainty into decisions, and support teams without prescribing implementation.
• An evidence-driven product approach grounded in benchmarks, evals, and explicit success criteria.
• Excellent written and verbal communication, good judgment, and the ability to align senior technical and business leaders across organizational boundaries.
• Enough technical depth to inspect APIs, traces, and benchmark results directly and earn the trust of senior researchers and engineers.

Ways to stand out from the crowd:

• Experience with LLM routers, AI gateways, model serving, distributed inference, or systems that dynamically allocate test-time compute.
• Experience taking research from prototype to a reliable, adopted developer product.
• A track record with open-source communities, SDKs, platform integrations, or developer ecosystems.
• Hands-on familiarity with relevant adjacent topics like agent building, eval systems, and inference optimization.

With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most hard-working and dedicated people on the planet working for us and, due to outstanding growth, our Product Management teams are growing fast. If you’re a creative technologist with a genuine passion for these topics, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 258,750 USD for Level 4, and 208,000 USD - 327,750 USD for Level 5.

You will also be eligible for equity and benefits.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.