Senior Architect - Agentic AI Systems & Runtime

NVIDIA; California (MO); On-site; USD 272,000 - 431,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Software Architect in the Agent Harness & Runtime Engineering team to design foundational systems for the next generation of agentic AI.

You will lead across runtimes, inference, evaluation, and orchestration, tackling distributed execution, data pipelines, HPC, cloud, and GPU environments while writing high-quality production code in Python, C++, Go, or Rust.

Qualifications

• Strong hands-on programming in Python, C++, Go, Rust, or similar languages.
• 12+ years of industry experience in software architecture or related fields.
• Deep expertise in software architecture, distributed systems, and large-scale design.

Responsibilities

• Architect and build scalable, reliable systems for agentic AI, spanning runtimes, harnesses, inference, evaluation, and orchestration.
• Solve large-scale systems challenges across distributed execution, data/ETL pipelines, HPC, cloud, Kubernetes, and GPU compute environments.
• Prototype ideas, write production-grade code, and provide technical leadership across teams.

Skills

Python

C++

Go

Rust

Distributed systems

AI/LLMs

Education

BS/MS in CS/CE/AI

Job description

NVIDIA is seeking a Senior Software Architect in the Agent Harness & Runtime Engineering team to design foundational systems for the next generation of agentic AI.

You will lead across runtimes, inference, evaluation, and orchestration, tackling distributed execution, data pipelines, HPC, cloud, and GPU environments while writing high-quality production code in Python, C++, Go, or Rust.