Senior AI Systems Architect – Agent Runtimes

NVIDIA Corporation; Santa Clara (CA); On-site; USD 224,000 - 431,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Software Architect in the Agent Harness & Runtime Engineering team to build foundational systems for next-generation agentic AI. You will design scalable, reliable architectures spanning runtimes, inference, evaluation, and orchestration, with a focus on performance and developer experience.

You will prototype ideas, write production-grade code in Python, C++, Go, or Rust, and lead across research, engineering, product, and infrastructure teams to solve complex AI

Qualifications

• Architect and build scalable, reliable AI systems across agent runtimes, harnesses, inference, evaluation, and orchestration.
• Deliver large-scale distributed execution and data pipelines for HPC, cloud, and GPU environments.
• Improve reliability, scalability, performance, resource use, and developer experience.
• Prototype ideas, write production-grade code, and lead across research, engineering, product, and infrastructure teams.

Responsibilities

• Architect scalable AI systems across agent runtimes, harnesses, inference, evaluation, and orchestration.
• Solve large-scale distributed execution and data pipelines challenges across HPC, cloud, Kubernetes, and GPU environments.
• Optimize systems for reliability, scalability, performance, and developer experience.
• Prototype ideas, write production code, and provide technical leadership across teams.

Skills

Software architecture

Distributed systems

Python

C++

Go

Rust

AI knowledge

Education

Bachelor's/Master's degree in CS/CE/AI

Tools

Kubernetes

Cloud platforms

Job description

NVIDIA is seeking a Senior Software Architect in the Agent Harness & Runtime Engineering team to build foundational systems for next-generation agentic AI. You will design scalable, reliable architectures spanning runtimes, inference, evaluation, and orchestration, with a focus on performance and developer experience.

You will prototype ideas, write production-grade code in Python, C++, Go, or Rust, and lead across research, engineering, product, and infrastructure teams to solve complex AI