Senior Technical Product Manager – AI Agents

NVIDIA Corporation; United States; Remote; USD 168,000 - 328,000; Full time

Benefits offered by this job

Equity compensation

Benefits

Job summary

NVIDIA is seeking a Senior Technical Product Manager to lead NeMo Relay, an open-source library that helps developers observe and control agent runs without replacing existing frameworks, models, or tools.

You will own the vision, strategy, and multi-release roadmap for NeMo Relay as a framework-neutral library that partners can embed, addressing lifecycle events, middleware, plugins, policy, observability, and adaptive performance tuning.

Qualifications

• Proven experience in product management for developer-facing libraries or infrastructure.
• Strong background in AI agent workflows, including LLM calls and tool calls.
• Experience bridging engineering, ecosystem, and leadership without direct authority.
• BS/MS in CS/EE or equivalent experience with 8+ years in software or ML ops.

Responsibilities

• Own the vision, strategy, and multi-release roadmap for NeMo Relay.
• Drive adoption via integrations with agent frameworks, observability tools, and ISVs.
• Collaborate with NeMo Guardrails, NeMo Fabric, NeMo Compass, and OpenShell teams.
• Turn ecosystem feedback into prioritized product decisions and roadmap updates.

Skills

AI agent landscape

Open-source frameworks

Developer-facing libraries

Product management

SDKs/infrastructure

Cross-functional leadership

Education

BS or MS in Computer Science / Electrical Engineering

Tools

OpenTelemetry

OpenInference

Agent tracing tools

Job description

NVIDIA is the defining technology company of the AI era. We are looking for a Senior Technical Product Manager to lead NeMo Relay, an open-source library that helps developers observe and control what happens inside agent runs, without replacing the frameworks, models, or tools they already use. Our team builds open-source libraries and reference architectures for agentic AI, including NeMo Relay, NeMo Fabric, and NemoClaw. We go to market through the ecosystem: our software is composed to be embedded into agent frameworks, developer tools, observability platforms, and third-party solutions, helping customers build agents that are safer, more observable, and more efficient on NVIDIA’s stack.

What you’ll be doing:

Take charge of the vision, strategy, and multi-release roadmap for NeMo Relay as a framework-neutral library partners can embed, addressing lifecycle events, middleware, plugins, policy, observability, and adaptive performance tuning. Drive adoption through integrations with agent frameworks, coding-agent harnesses, observability vendors, and ISVs, and build the examples that show developers how to use Relay in real systems. Partner with the teams behind NeMo Guardrails, NeMo Fabric, NeMo Compass and OpenShell to make Relay work seamlessly with their components. Turn open-source community and ecosystem feedback into prioritized product decisions. Work with engineering and program management to plan releases and keep roadmap communications accurate. Become a recognized voice in agent observability, safety, and optimization through talks, content, and community engagement.

What we need to see:

Deep familiarity with the AI agent landscape: open-source frameworks, coding agents and harnesses, and commercial agent platforms. Proven understanding of agent execution, including LLM calls, tool calls, and multi-agent workflows. Understanding of what developers need to operate agents in production: tracing, evaluation, guardrails, and cost and performance tuning. Product management background on developer-facing libraries, SDKs, or infrastructure that other companies build on. Proven track record to lead product direction in ambiguous, fast paced areas and to influence engineering, ecosystem, and leadership partners without direct authority. BS or MS in Computer Science, Electrical Engineering, or equivalent experience. 8+ years of combined work in software development, ML ops, and/or technical product management, including 5+ years shipping enterprise software or infrastructure.

Ways to stand out from the crowd:

History of taking an open-source project from early releases to broad ecosystem adoption. Track record of ecosystem-led go-to-market, such as integrations, co-engineering, or embedding into third-party products. Hands-on familiarity with OpenTelemetry, OpenInference, or agent tracing and evaluation tools. Ability to make exceptional runtime concepts simple for both developers and executives.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 168,000 USD – 258,750 USD for Level 4; and 208,000 USD – 327,750 USD for Level 5. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November13, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA.