Senior Engineering Manager, Enterprise AI Platform

NVIDIA; Santa Clara (CA); On-site; USD 272,000 - 431,250; Full time

Job summary

NVIDIA seeks a Senior Engineering Manager for Agentic Systems & Platform Architecture to lead strategy and execution for the agentic developer platform, aligning across teams to build scalable capabilities that accelerate productivity and agent quality.

You will drive POC-driven adoption, governance, and safety tooling, and guide a high-performing team in a fast-evolving space to deliver measurable business impact at scale.

Qualifications

• Bachelor’s degree in CS/Engineering or equivalent experience
• 10+ overall years in software engineering, including 4+ years managing high-performing teams
• Strong hands-on experience with evolving agent architectures and open-source libraries; deep expertise in LLM/agent architectures—leading POCs and integrating them into real business use cases with measurable adoption/impact
• Ability to turn fast-moving, ambiguous problem spaces into clear platform strategy, roadmap, and outcomes

Responsibilities

• Track and deeply understand evolving agent development patterns across NVIDIA and the broader ecosystem
• Identify gaps and friction in current agent architectures, and translate insights into a platform strategy that boosts developer velocity and agent quality—backed by evaluations, benchmarking, and feedback loops
• Assess and integrate open source and third-party tools where they add leverage; drive clear build-vs-use decisions
• Architect and integrate high-performance data pipelines, RAG systems, vector databases, and GPU-optimized training and inference workflows.
• Lead integration of the AI Data Platform into NVIDIA’s on-prem AI Factory, optimizing GPU-to-storage throughput, data locality, and distributed inference performance.
• Establish and enforce robust Agent Governance policies across the platform, covering model/tool usage, data lineage, and ensuring adherence to compliance and Responsible AI frameworks.
• Design, implement, and maintain a centralized Agent Safety Toolkit, providing developers with pre-vetted components for input/output guardrails and prompt injection defenses
• Lead and grow a high-performing team along with a multi-functional community to standardize procedures and scale adoption

Skills

Agent architectures

LLM/agent architectures

Engineering leadership

Roadmap & platform strategy

Developer platform experience

Education

Bachelor’s degree in CS/Engineering

Tools

PyTorch

TensorFlow

Kubernetes

APIs/SDKs

Job description

NVIDIA seeks a Senior Engineering Manager for Agentic Systems & Platform Architecture to lead strategy and execution for the agentic developer platform, aligning across teams to build scalable capabilities that accelerate productivity and agent quality.

You will drive POC-driven adoption, governance, and safety tooling, and guide a high-performing team in a fast-evolving space to deliver measurable business impact at scale.