Senior AI Agent Runtime Architect for Core Platform

NVIDIA; Santa Clara (CA); On-site; USD 184,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA in Santa Clara is seeking a Senior Software Engineer to help build NeMo Helix, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems at scale. This role sits on the Core team responsible for an open source plugin-based agent execution framework and robust APIs.

You will design flexible execution systems, mentor peers, and advance core platform APIs, while improving reliability and performance across Docker, Kubernetes, and cloud-native environments.

Qualifications

• BS, MS, or equivalent in Computer Science, Computer Engineering, or a related field.
• 10+ years of professional software engineering experience building production systems.
• Ability to work in a fast and ambiguous environment.
• Strong communication skills at all levels (engineer, product, marketing).
• Solid system design with reliability, scalability, security, and performance considerations.
• Experience with distributed systems and container orchestration (Kubernetes).
• Proficient Python with API design, typing, testing, and debugging.

Responsibilities

• Design and implement an Agentic Execution system adaptable to multiple environments (local, Kubernetes, Slurm, on prem).
• Provide senior technical leadership through architecture reviews, code reviews, and mentorship.
• Build and maintain Core Platform APIs for jobs, data, entities, secrets, RBAC, and authentication.
• Extend a plugin architecture to enable external teams to add capabilities.
• Improve reliability, observability, and performance across NeMo Helix and OSS components.
• Develop strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows.

Skills

10+ years experience

Strong system design

Distributed systems

Python engineering

SDKs / libraries / plugins

Independently drive work

Excellent communication

Kubernetes

Cloud-native services

API design

Education

BS/MS or equivalent in CS/Engineering

Tools

Docker

Kubernetes

Job description

NVIDIA in Santa Clara is seeking a Senior Software Engineer to help build NeMo Helix, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems at scale. This role sits on the Core team responsible for an open source plugin-based agent execution framework and robust APIs.

You will design flexible execution systems, mentor peers, and advance core platform APIs, while improving reliability and performance across Docker, Kubernetes, and cloud-native environments.