Senior Architect, Scalable Agentic AI Systems

NVIDIA; Santa Clara (CA); On-site; USD 224,000 - 431,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is hiring a Senior Software Architect in the Agent Harness & Runtime Engineering team to build foundational systems for the next generation of agentic AI. Our team works at the intersection of AI and systems engineering, tackling challenges across agent runtimes, inference, evaluation, and large-scale execution.

You will architect scalable systems, optimize for reliability and performance, and prototype ideas while guiding cross-functional teams.

Qualifications

• BS, MS, or equivalent experience in Computer Science, Computer Engineering, AI, or a related field with 12+ years of industry experience.
• Strong foundation in modern AI, including LLMs, multimodal models, inference, agentic AI, and evaluation.
• Deep expertise in software architecture, distributed systems, and large-scale systems design.

Responsibilities

• Architect and build scalable, reliable systems for agentic AI, spanning agent runtimes, harnesses, inference, evaluation, and orchestration.
• Solve large-scale systems challenges across distributed execution, data/ETL pipelines, HPC, cloud, Kubernetes, and GPU compute environments.
• Prototype emerging ideas, write production-grade code, and provide technical leadership across research, engineering, product, and infrastructure teams.

Skills

Python

C++

Go

Rust

Distributed systems

Large-scale design

Education

BS/MS in CS/AI

Job description

NVIDIA is hiring a Senior Software Architect in the Agent Harness & Runtime Engineering team to build foundational systems for the next generation of agentic AI. Our team works at the intersection of AI and systems engineering, tackling challenges across agent runtimes, inference, evaluation, and large-scale execution.

You will architect scalable systems, optimize for reliability and performance, and prototype ideas while guiding cross-functional teams.