Senior Agentic AI Systems Architect

NVIDIA Gruppe; Austin (TX); On-site; USD 224,000 - 431,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is hiring a Senior Software Architect for the Agent Harness & Runtime Engineering team to build foundational AI systems. You’ll work across agent runtimes, inference, evaluation, and orchestration, shaping scalable, production-quality software.

The role requires deep expertise in software architecture, distributed systems, and modern AI. Strong coding skills in Python, C++, Go, or Rust are essential, with experience in GPU infrastructure and cloud environments.

Qualifications

• BS, MS, or equivalent experience in CS/CE/AI or related field.
• 12+ years of relevant industry experience.
• Strong foundation in modern AI including LLMs and evaluation.

Responsibilities

• Architect and build scalable, reliable systems for agentic AI across runtimes, harnesses, inference, evaluation and orchestration.
• Solve large-scale systems challenges across distributed execution, data/ETL pipelines, HPC, cloud, Kubernetes, and GPU compute environments.
• Optimize systems for reliability, scalability, performance, resource utilization and developer experience.
• Prototype ideas, write production-grade code, and lead across research, engineering, product and infra teams.

Skills

Distributed systems

Software architecture

Python

C++

Go

Rust

Education

BS/MS in Computer Science/Engineering or AI

Tools

Kubernetes

ETL pipelines

GPU compute environments

Job description

NVIDIA is hiring a Senior Software Architect for the Agent Harness & Runtime Engineering team to build foundational AI systems. You’ll work across agent runtimes, inference, evaluation, and orchestration, shaping scalable, production-quality software.

The role requires deep expertise in software architecture, distributed systems, and modern AI. Strong coding skills in Python, C++, Go, or Rust are essential, with experience in GPU infrastructure and cloud environments.