Senior Technical Program Manager — Local AI Agents

NVIDIA AI; Redmond (WA); On-site; USD 168,000 - 322,000; Full time

Job summary

NVIDIA seeks a Senior Technical Program Manager to lead multi-functional initiatives for local AI agents, uniting engineering, research, product, security, and partners behind a clear roadmap and measurable results. Responsibilities cover local inference, agent runtimes, Windows integration, and developer tools.

You will gather insights from open ecosystems and domain-specific agents to guide NVIDIA’s priorities and improve onboarding, docs, samples, and adoption across NVIDIA systems.

Qualifications

• Bachelor’s degree or equivalent experience in practice.
• 8+ years leading complex software, platform, systems, or AI/ML programs from concept through production release.
• Technical proficiency in contemporary AI software stacks, encompassing model prediction, agent coordination, tool application, evaluation, and local or hybrid deployment.
• Experience building coordinated plans across multiple engineering organizations and resolving technical dependencies without direct authority.
• Experience defining measurable quality and release criteria, using data to make tradeoffs, and separating prototypes from validated capabilities.
• Ability to explain architecture, risk, and program status clearly to technical teams, partners, and executives.

Responsibilities

• Own the coordinated roadmap from prototype through release for local AI agent capabilities, with clear scope, achievements, owners, dependencies, and completion criteria.
• Translate product goals and ecosystem signals into harmonized plans covering agent frameworks, MCP and tool connections, memory and skills, computer use, local inference, model routing, and application integration.
• Partner with engineering and research teams to define evaluation and release gates for task success, latency, efficiency, memory use, power, reliability, setup time, privacy, and user trust.
• Coordinate programs across Windows platform groups, GPU and driver groups, model and runtime groups, product security, developer relations, Microsoft, OEMs, ISVs, and open-source communities.
• Build concise dashboards and decision forums that surface program health, technical tradeoffs, risks, and evidence; communicate clearly with engineers and senior leaders.
• Use developer and customer feedback to improve onboarding, documentation, samples, compatibility, and adoption across supported NVIDIA systems.

Skills

Python

C++

Automation

Agent frameworks

Local inference

Education

Bachelor's degree in CS/CE or equivalent

Tools

TensorRT-LLM

Ollama

llama.cpp

PyTorch

ONNX Runtime

Windows ML

Job description

NVIDIA seeks a Senior Technical Program Manager to lead multi-functional initiatives for local AI agents, uniting engineering, research, product, security, and partners behind a clear roadmap and measurable results. Responsibilities cover local inference, agent runtimes, Windows integration, and developer tools.

You will gather insights from open ecosystems and domain-specific agents to guide NVIDIA’s priorities and improve onboarding, docs, samples, and adoption across NVIDIA systems.