Engineering Manager, Local AI Agents

NVIDIA; Redmond (WA); On-site; USD 290,000 - 431,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a senior software architect to lead the design and implementation of local AI agent runtimes on Windows and NVIDIA RTX systems. You will define interfaces across models, tools, GPU software, and OS services, guiding prototyping, reviews, and performance analysis.

You will own CI/CD, evaluation, compatibility, and regression systems across Windows releases and agent frameworks, while collaborating with AI research, hardware teams, and external partners to deliver durable

Qualifications

• 10+ years of software engineering experience, including 3+ years managing engineers or leading a comparable technical organization.
• Experience hiring and developing engineers, setting goals, providing constructive feedback, and building an inclusive team.
• A track record delivering complex software platforms from architecture through production operation.
• Technical fluency in AI agents, model inference, systems software, and local or hybrid deployment with architecture guidance.
• Ability to align engineering, research, product, security, and external partners around clear decisions and measurable outcomes.
• Proficiency with C++ or Python.

Responsibilities

• Lead the architecture and implementation of local AI agent runtimes on Windows and NVIDIA RTX systems, with clear interfaces across models, tools, GPU software, OS services, and applications.
• Guide hands-on development through prototypes, design and code reviews, performance analysis, and debugging; help the team turn research ideas into reliable C++ and Python software.
• Own CI/CD, evaluation, compatibility, and regression systems across Windows releases, drivers, GPUs, models, and agent frameworks; add telemetry and diagnostics for reproducibility.
• Partner with AI research, GPU and driver, Windows platform, product security, Microsoft, OEM, ISV, and open-source teams to land durable interfaces and production integrations.

Skills

C++

Python

AI systems

Team leadership

Education

Bachelor's degree in Computer Science or Computer Engineering or equivalent

Tools

OpenClaw

Hermes

LangChain

MCP

Job description

Artificial intelligence is moving from passive assistance to agents that can reason, use tools, and complete work on a person's device. NVIDIA is building the software foundation that helps developers and partners deliver these experiences privately, efficiently, and responsibly across GeForce RTX, NVIDIA RTX PRO, RTX Spark, DGX Spark, and DGX Station systems.

What You'll Be Doing

• Lead the architecture and implementation of local AI agent runtimes on Windows and NVIDIA RTX systems, with clear interfaces across models, tools, GPU software, operating-system services, and applications.
• Guide hands-on development through prototypes, design and code reviews, performance analysis, and debugging; help the team turn research ideas into reliable C++ and Python software.
• Build core agent capabilities including MCP and tool routing, persistent memory, skills, scheduling, multi-agent coordination, computer use, and policy-aware local or hybrid model routing.
• Own CI/CD, evaluation, compatibility, and regression systems across Windows releases, drivers, GPUs, models, and agent frameworks; add telemetry and diagnostics that make failures reproducible.
• Partner with AI research, GPU and driver, Windows platform, product security, Microsoft, OEM, ISV, and open-source teams to land durable interfaces and production integrations.
• Hire and develop engineers, set a high technical bar, allocate capacity, and create an environment where the team can make sound decisions and deliver maintainable software.

What We Need To See

• Bachelor's degree in Computer Science, Computer Engineering, or a related field, or equivalent experience in practice.
• 10+ years of software engineering experience, including 3+ years managing engineers or leading a comparable technical organization.
• Experience hiring and developing engineers, setting goals, providing useful feedback, and building an inclusive team environment.
• A record of delivering complex software platforms or systems from architecture through production operation.
• Technical fluency in AI agents, model inference, systems software, and local or hybrid deployment, with the judgment to guide architecture and execution.
• Ability to align engineering, research, product, security, and external partners around clear decisions and measurable outcomes.
• Proficiency with C++ or Python.

Ways To Stand Out From The Crowd

• Hands-on experience with Windows internals, process isolation, virtualization, containers, or sandboxing.
• Familiarity with OpenClaw, Hermes, LangChain or similar agent frameworks; MCP; memory, skills, multi-agent, or computer-use patterns.
• Experience with TensorRT-LLM, Ollama, llama.cpp, vLLM, PyTorch, ONNX Runtime, Windows ML, model optimization, or quantization.
• Experience with CUDA, GPU performance, local models on consumer hardware, or privacy-aware inference routing.
• Experience contributing to open-source projects or working with Microsoft, OEMs, ISVs, and developer communities.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 224,000 USD - 356,500 USD for Level 3, and 272,000 USD - 431,250 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 28, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

, , JR2024266