Technical Program Manager -Local AI Agents

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 180,000 - 322,000; Full time

Job summary

NVIDIA is seeking a Senior Technical Program Manager to lead multi-functional initiatives for local AI agents across Windows and hybrid environments. You will coordinate engineering, research, product, security, and external collaborators toward a shared roadmap with measurable results.

You will define evaluation gates, manage dependencies, and build dashboards to surface risks and progress. Experience with AI software stacks and open ecosystems is highly valued by the team.

Qualifications

• 8+ years leading complex software, platform, systems, or AI/ML programs from concept through production release.
• Bachelor's degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.

Responsibilities

• Own the coordinated roadmap from prototype through release for local AI agent capabilities with clear scope, owners, dependencies, and criteria.
• Translate product goals into harmonized plans covering agent frameworks, memory, skills, and local inference across platforms.
• Define evaluation and release gates for task success, latency, efficiency, memory use, power, reliability, setup time, privacy, and user trust.
• Coordinate programs across Windows platform groups, GPU/driver groups, model/runtime groups, product security, and partners.
• Build dashboards and decisions forums to surface program health, tradeoffs, risks, and evidence; communicate with engineers and leaders.
• Gather feedback to improve onboarding, documentation, samples, compatibility, and adoption across NVIDIA systems.

Skills

Python

C++

Education

Bachelor's degree in Computer Science/Engineering

Tools

LangChain

TensorRT-LLM

llama.cpp

PyTorch

ONNX Runtime

Job description

Artificial intelligence is moving from passive assistance to agents that can reason, use tools, and complete work on a person's device. NVIDIA is building the software foundation that helps developers and partners deliver these experiences privately, efficiently, and responsibly across GeForce RTX, NVIDIA RTX PRO, RTX Spark, DGX Spark, and DGX Station systems.

We seek a Senior Technical Program Manager to lead multi-functional initiatives involving local and hybrid AI agents. You will unite engineering, research, product, security, developer relations, and external collaborators behind a clear roadmap and measurable results. Your responsibilities include local model inference, agent runtimes, Windows integration, developer tools, security controls, and user experiences. Additionally, you will gather insights from open ecosystems like Hermes and OpenClaw, desktop-agent projects such as Perplexity, and domain-specific agents to guide NVIDIA’s focus on developer and user priorities.

What you'll be doing:

• Own the coordinated roadmap from prototype through release for local AI agent capabilities, with clear scope, achievements, owners, dependencies, and completion criteria.
• Translate product goals and ecosystem signals into harmonized plans covering agent frameworks, MCP and tool connections, memory and skills, computer use, local inference, model routing, and application integration.
• Partner with engineering and research teams to define evaluation and release gates for task success, latency, efficiency, memory use, power, reliability, setup time, privacy, and user trust.
• Coordinate programs across Windows platform groups, GPU and driver groups, model and runtime groups, product security, developer relations, Microsoft, OEMs, ISVs, and open-source communities.
• Build concise dashboards and decision forums that surface program health, technical tradeoffs, risks, and evidence; communicate clearly with engineers and senior leaders.
• Use developer and customer feedback to improve onboarding, documentation, samples, compatibility, and adoption across supported NVIDIA systems.

What we need to see:

• Bachelor's degree in Computer Science, Computer Engineering, or a related field, or equivalent experience in practice.
• 8+ years leading complex software, platform, systems, or AI/ML programs from concept through production release.
• Technical proficiency in contemporary AI software stacks, encompassing model prediction, agent coordination, tool application, evaluation, and local or hybrid deployment.
• Experience building coordinated plans across multiple engineering organizations and resolving technical dependencies without direct authority.
• Experience defining measurable quality and release criteria, using data to make tradeoffs, and separating prototypes from validated capabilities.
• Ability to explain architecture, risk, and program status clearly to technical teams, partners, and executives.

Ways to stand out from the crowd:

• Hands‑on experience with Python, C++, or software automation.
• Familiarity with OpenClaw, Hermes, LangChain or similar agent frameworks; MCP; and persistent memory, skills, multi‑agent, or computer‑use patterns.
• Familiarity with local inference technologies such as TensorRT-LLM, Ollama, llama.cpp, vLLM, PyTorch, ONNX Runtime, or Windows ML, plus model optimization or quantization.
• Experience with Windows systems, CUDA or GPU acceleration, sandboxing, policy controls, privacy‑aware networking, or secure credential handling.
• Experience collaborating with Microsoft, OEMs, ISVs, open‑source maintainers, or domain‑solution partners.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 258,750 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.

You will also be eligible for equity and benefits.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.