Technical Program Manager -Local AI Agents

Nvidia Corporation in

Santa Clara (CA)

On-site

USD 200,000 - 322,000

Full time

2 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA is seeking a Senior Technical Program Manager for Local AI Agents (Finance) to lead multi-functional initiatives—from prototype to production—across local and hybrid AI agent capabilities. You will partner with engineering, research, security, and external collaborators to deliver measurable results on Windows, memory, and tool integration.

You will define release gates, coordinate across Windows and driver teams, and build concise dashboards to surface program health and risks.

Qualifications

  • Bachelor's degree in Computer Science, Computer Engineering, or related field; equivalent experience.
  • 8+ years leading complex software, platform, systems, or AI/ML programs from concept through production release.
  • Technical proficiency in AI software stacks including model prediction, agent coordination, and local/hybrid deployment.
  • Experience coordinating plans across multiple engineering orgs and resolving dependencies without direct authority.
  • Experience defining measurable quality and release criteria using data to trade off prototypes and validated capabilities.
  • Ability to explain architecture, risk, and program status clearly to tech teams, partners, and executives.

Responsibilities

  • Own the coordinated roadmap from prototype through release for local AI agent capabilities.
  • Translate goals into harmonized plans covering agent frameworks, memory, and tool connections.
  • Define evaluation and release gates for latency, memory, power, reliability, privacy, and trust.
  • Coordinate programs across Windows platform groups, GPU/driver groups, model/runtime groups, and partners.
  • Build dashboards and decision forums that surface health, risks, and evidence; communicate with engineers and leaders.
  • Improve onboarding, documentation, samples, compatibility, and adoption across NVIDIA systems.

Skills

Python
C++
Software automation
AI software stacks
Cross-functional planning
Data-driven decisions
Architecture communication

Education

Bachelor's degree in Computer Science or related

Tools

TensorRT-LLM
Ollama
llama.cpp
vLLM
PyTorch
ONNX Runtime
Windows ML
CUDA
GPU acceleration
LangChain

Job description

Technical Program Manager -Local AI Agents (Finance)

Artificial intelligence is moving from passive assistance to agents that can reason, use tools, and complete work on a person's device. NVIDIA is building the software foundation that helps developers and partners deliver these experiences privately, efficiently, and responsibly across GeForce RTX, NVIDIA RTX PRO, RTX Spark, DGX Spark, and DGX Station systems.

We seek a Senior Technical Program Manager to lead multi-functional initiatives involving local and hybrid AI agents. You will unite engineering, research, product, security, developer relations, and external collaborators behind a clear roadmap and measurable results. Your responsibilities include local model inference, agent runtimes, Windows integration, developer tools, security controls, and user experiences. Additionally, you will gather insights from open ecosystems like Hermes and OpenClaw, desktop-agent projects such as Perplexity, and domain-specific agents to guide NVIDIA's focus on developer and user priorities.

What you'll be doing:
  • Own the coordinated roadmap from prototype through release for local AI agent capabilities, with clear scope, achievements, owners, dependencies, and completion criteria.
  • Translate product goals and ecosystem signals into harmonized plans covering agent frameworks, MCP and tool connections, memory and skills, computer use, local inference, model routing, and application integration.
  • Partner with engineering and research teams to define evaluation and release gates for task success, latency, efficiency, memory use, power, reliability, setup time, privacy, and user trust.
  • Coordinate programs across Windows platform groups, GPU and driver groups, model and runtime groups, product security, developer relations, Microsoft, OEMs, ISVs, and open-source communities.
  • Build concise dashboards and decision forums that surface program health, technical tradeoffs, risks, and evidence; communicate clearly with engineers and senior leaders.
  • Use developer and customer feedback to improve onboarding, documentation, samples, compatibility, and adoption across supported NVIDIA systems.
What we need to see:
  • Bachelor's degree in Computer Science, Computer Engineering, or a related field, or equivalent experience in practice.
  • 8+ years leading complex software, platform, systems, or AI/ML programs from concept through production release.
  • Technical proficiency in contemporary AI software stacks, encompassing model prediction, agent coordination, tool application, evaluation, and local or hybrid deployment.
  • Experience building coordinated plans across multiple engineering organizations and resolving technical dependencies without direct authority.
  • Experience defining measurable quality and release criteria, using data to make tradeoffs, and separating prototypes from validated capabilities.
  • Ability to explain architecture, risk, and program status clearly to technical teams, partners, and executives.
Ways to stand out from the crowd:
  • Hands-on experience with Python, C++, or software automation.
  • Familiarity with OpenClaw, Hermes, LangChain or similar agent frameworks; MCP; and persistent memory, skills, multi-agent, or computer-use patterns.
  • Familiarity with local inference technologies such as TensorRT-LLM, Ollama, llama.cpp, vLLM, PyTorch, ONNX Runtime, or Windows ML, plus model optimization or quantization.
  • Experience with Windows systems, CUDA or GPU acceleration, sandboxing, policy controls, privacy-aware networking, or secure credential handling.
  • Experience collaborating with Microsoft, OEMs, ISVs, open-source maintainers, or domain-solution partners.

Widely considered to be one of the technology world's most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 258,750 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.

You will also be eligible for equity and benefits .

Applications for this job will be accepted at least until August 28, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Technical Program Manager -Local AI Agents
Technical Program Manager -Local AI Agents

NVIDIA AI • Redmond (WA)

On-site
USD 168,000 - 322,000
Technical Program Manager -Local AI Agents
Technical Program Manager -Local AI Agents

NVIDIA • Santa Clara (CA)

On-site
USD 210,000 - 322,000
Engineering Manager, Local AI Agents
Engineering Manager, Local AI Agents

NVIDIA • Santa Clara (CA)

On-site
USD 272,000 - 431,000
Equity
Benefits
Technical Program Manager -Local AI Agents
Technical Program Manager -Local AI Agents

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 180,000 - 322,000
Principal Engineer, Local AI - Agents and Systems
Principal Engineer, Local AI - Agents and Systems

NVIDIA • Redmond (WA)

On-site
USD 272,000 - 432,000
Equity
Benefits
Engineering Manager, Local AI Agents
Engineering Manager, Local AI Agents

NVIDIA • Redmond (WA)

On-site
USD 290,000 - 431,000
Equity
Benefits
Senior Engineer - AI Agents and Systems
Senior Engineer - AI Agents and Systems

NVIDIA • Redmond (WA)

On-site
USD 272,000 - 432,000
Equity
Benefits
Senior Engineer, Local AI - Agents and Systems
Senior Engineer, Local AI - Agents and Systems

NVIDIA • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Equity
Benefits package
Senior Engineer, Local AI - Agents and Systems
Senior Engineer, Local AI - Agents and Systems

NVIDIA • Redmond (WA)

On-site
USD 184,000 - 357,000
Equity
Benefits package
Senior Software Engineer, Agent Simulation and Evaluation
Senior Software Engineer, Agent Simulation and Evaluation

Nvidia Corporation in • Santa Clara (CA)

On-site
USD 152,000 - 242,000
Equity
Benefits