Engineering Manager, Local AI Agent Runtimes

NVIDIA; Santa Clara (CA); On-site; USD 272,000 - 431,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking an Engineering Manager to lead a team building local and hybrid AI agent technology on NVIDIA RTX and Windows platforms. You will drive architectural direction, mentor engineers, and deliver production software across runtimes, local inference, and security controls.

You will collaborate with AI research, hardware, security, and ecosystem partners to ship durable interfaces and open integrations.

Qualifications

• Bachelor's degree or equivalent experience in practice.
• 10+ years of software engineering experience, incl. 3+ years managing engineers.
• Experience hiring and developing engineers and building inclusive teams.
• Track record delivering complex software platforms or systems from architecture to production.

Responsibilities

• Lead architecture and implementation of local AI agent runtimes on Windows and NVIDIA RTX systems.
• Guide hands-on development through prototypes, design reviews, performance analysis, and debugging.
• Build core agent capabilities including MCP, tool routing, persistent memory, skills, scheduling, and multi-agent coordination.
• Own CI/CD, evaluation, compatibility, and regression systems across Windows releases, drivers, GPUs, models, and frameworks; add telemetry and diagnostics.
• Partner with AI research, GPU/driver, Windows platform, product security, Microsoft, OEM, ISV, and open-source teams to land durable interfaces.
• Hire and develop engineers, set a high technical bar, allocate capacity, and foster an environment for sound decisions and maintainable software.

Skills

AI agent architectures

C++

Python

Team leadership

Windows platform

Education

Bachelor's degree in Computer Science or related

Tools

Windows internals

OpenClaw

LangChain

TensorRT-LLM

llama.cpp

Job description

NVIDIA is seeking an Engineering Manager to lead a team building local and hybrid AI agent technology on NVIDIA RTX and Windows platforms. You will drive architectural direction, mentor engineers, and deliver production software across runtimes, local inference, and security controls.

You will collaborate with AI research, hardware, security, and ecosystem partners to ship durable interfaces and open integrations.