Senior Software Architect - AI Platform Core (Open Source)

NVIDIA; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Job summary

NVIDIA is seeking a Senior Software Engineer to help build the NeMo Platform, an open source plugin-based AI execution framework. You will lead design reviews, own core APIs, and extend a flexible plugin model across local, Kubernetes, Slurm, and on-prem environments.

You will drive reliability, performance, and observability while shipping features at scale for autonomous AI workloads, collaborating with a wide cross-functional team.

Qualifications

• BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field.
• 10+ years of professional software engineering experience building production systems.
• Strong system design skills and ability to work in fast, ambiguous environments.
• Excellent communication skills for architectural discussions with engineers, product and marketing teams.
• Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration.
• Excellent Python engineering skills including API design, typing, testing, and debugging.

Responsibilities

• Designing an Agentic Execution system flexible enough for local, Kubernetes, Slurm, and on-prem environments.
• Provide senior technical leadership through design reviews, code reviews, mentoring, and ownership of cross-component problems.
• Building and maintaining Core Platform APIs for running jobs, storing data, entities, secrets, and RBAC and Auth.
• Extending a flexible Plugin Architecture to allow teams and external customers to add capabilities.
• Building in the open in an OSS repository and maintaining high community standards.
• Shipping code rapidly with a focus on reliability, observability, and performance.

Skills

Python

Kubernetes

Distributed systems

API design

Software architecture

RBAC and security

Education

BS/MS in Computer Science or related field

Tools

Docker

Kubernetes

Slurm

Job description

NVIDIA is seeking a Senior Software Engineer to help build the NeMo Platform, an open source plugin-based AI execution framework. You will lead design reviews, own core APIs, and extend a flexible plugin model across local, Kubernetes, Slurm, and on-prem environments.

You will drive reliability, performance, and observability while shipping features at scale for autonomous AI workloads, collaborating with a wide cross-functional team.