Technical Program Manager -Local AI Agents

NVIDIA AI; Redmond (WA); On-site; USD 168,000 - 322,000; Full time

Job summary

NVIDIA seeks a Senior Technical Program Manager to lead multi-functional initiatives for local AI agents, uniting engineering, research, product, security, and partners behind a clear roadmap and measurable results. Responsibilities cover local inference, agent runtimes, Windows integration, and developer tools.

You will gather insights from open ecosystems and domain-specific agents to guide NVIDIA’s priorities and improve onboarding, docs, samples, and adoption across NVIDIA systems.

Qualifications

• Bachelor’s degree or equivalent experience in practice.
• 8+ years leading complex software, platform, systems, or AI/ML programs from concept through production release.
• Technical proficiency in contemporary AI software stacks, encompassing model prediction, agent coordination, tool application, evaluation, and local or hybrid deployment.
• Experience building coordinated plans across multiple engineering organizations and resolving technical dependencies without direct authority.
• Experience defining measurable quality and release criteria, using data to make tradeoffs, and separating prototypes from validated capabilities.
• Ability to explain architecture, risk, and program status clearly to technical teams, partners, and executives.

Responsibilities

• Own the coordinated roadmap from prototype through release for local AI agent capabilities, with clear scope, achievements, owners, dependencies, and completion criteria.
• Translate product goals and ecosystem signals into harmonized plans covering agent frameworks, MCP and tool connections, memory and skills, computer use, local inference, model routing, and application integration.
• Partner with engineering and research teams to define evaluation and release gates for task success, latency, efficiency, memory use, power, reliability, setup time, privacy, and user trust.
• Coordinate programs across Windows platform groups, GPU and driver groups, model and runtime groups, product security, developer relations, Microsoft, OEMs, ISVs, and open-source communities.
• Build concise dashboards and decision forums that surface program health, technical tradeoffs, risks, and evidence; communicate clearly with engineers and senior leaders.
• Use developer and customer feedback to improve onboarding, documentation, samples, compatibility, and adoption across supported NVIDIA systems.

Skills

Python

C++

Automation

Agent frameworks

Local inference

Education

Bachelor's degree in CS/CE or equivalent

Tools

TensorRT-LLM

Ollama

llama.cpp

PyTorch

ONNX Runtime

Windows ML

Job description

Job Requisition ID

JR2024270

Job Category

Program Manager

Time Type

Full time

Artificial intelligence is moving from passive assistance to agents that can reason, use tools, and complete work on a person's device. NVIDIA is building the software foundation that helps developers and partners deliver these experiences privately, efficiently, and responsibly across GeForce RTX, NVIDIA RTX PRO, RTX Spark, DGX Spark, and DGX Station systems.

We seek a Senior Technical Program Manager to lead multi-functional initiatives involving local and hybrid AI agents. You will unite engineering, research, product, security, developer relations, and external collaborators behind a clear roadmap and measurable results. Your responsibilities include local model inference, agent runtimes, Windows integration, developer tools, security controls, and user experiences. Additionally, you will gather insights from open ecosystems like Hermes and OpenClaw, desktop-agent projects such as Perplexity, and domain-specific agents to guide NVIDIA’s focus on developer and user priorities.

What You’ll Be Doing

• Own the coordinated roadmap from prototype through release for local AI agent capabilities, with clear scope, achievements, owners, dependencies, and completion criteria.
• Translate product goals and ecosystem signals into harmonized plans covering agent frameworks, MCP and tool connections, memory and skills, computer use, local inference, model routing, and application integration.
• Partner with engineering and research teams to define evaluation and release gates for task success, latency, efficiency, memory use, power, reliability, setup time, privacy, and user trust.
• Coordinate programs across Windows platform groups, GPU and driver groups, model and runtime groups, product security, developer relations, Microsoft, OEMs, ISVs, and open-source communities.
• Build concise dashboards and decision forums that surface program health, technical tradeoffs, risks, and evidence; communicate clearly with engineers and senior leaders.
• Use developer and customer feedback to improve onboarding, documentation, samples, compatibility, and adoption across supported NVIDIA systems.

What We Need To See

• Bachelor’s degree in Computer Science, Computer Engineering, or a related field, or equivalent experience in practice.
• 8+ years leading complex software, platform, systems, or AI/ML programs from concept through production release.
• Technical proficiency in contemporary AI software stacks, encompassing model prediction, agent coordination, tool application, evaluation, and local or hybrid deployment.
• Experience building coordinated plans across multiple engineering organizations and resolving technical dependencies without direct authority.
• Experience defining measurable quality and release criteria, using data to make tradeoffs, and separating prototypes from validated capabilities.
• Ability to explain architecture, risk, and program status clearly to technical teams, partners, and executives.

Ways To Stand Out From The Crowd

• Hands-on experience with Python, C++, or software automation.
• Familiarity with OpenClaw, Hermes, LangChain or similar agent frameworks; MCP; and persistent memory, skills, multi-agent, or computer-use patterns.
• Familiarity with local inference technologies such as TensorRT-LLM, Ollama, llama.cpp, vLLM, PyTorch, ONNX Runtime, or Windows ML, plus model optimization or quantization.
• Experience with Windows systems, CUDA or GPU acceleration, sandboxing, policy controls, privacy-aware networking, or secure credential handling.
• Experience collaborating with Microsoft, OEMs, ISVs, open-source maintainers, or domain-solution partners.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 258,750 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 28, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.