Senior Software Engineer, Core AI Platform & Orchestration

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Bonus potential

Job summary

NVIDIA is seeking a Senior Software Engineer to advance the NeMo Platform, a plugin-based AI platform for running and optimizing Agents at scale. You will join the Core team, shaping a flexible agent execution framework across local, Kubernetes, Slurm, and on‑prem environments.

You’ll lead design reviews, mentor teammates, and own core APIs for jobs, data, secrets, and RBAC. Expect rapid iterations, open-source collaboration, and high-performance goals.

Qualifications

• BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field
• 10+ years of professional software engineering experience building production systems
• Comfort working in a very fast and ambiguous environment
• Exceptional communication, both verbal and written. This includes the ability to produce and review high quality architectural RFCs, and to discuss them clearly with the right level of technical detail for the right people (Engineer, Product, Marketing, etc.)
• Strong system design skills, with a pragmatic flexibility and phenomenal instincts to invent robust systems quickly without over-complicating. Strong understanding of reliability, scalability, security, and performance tradeoffs in production infrastructure
• Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration
• Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design
• Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces
• Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries

Responsibilities

• Working in a product research environment with fast iteration, high ownership, and pragmatic decisions under production constraints
• Designing an Agentic Execution system flexible for multiple environments (local, k8s, Slurm, on prem)
• Provide senior technical leadership through design reviews, code reviews, mentoring, and ownership of cross-component problems
• Building and maintaining Core Platform APIs for running jobs, storing data, entities, secrets, and RBAC/Auth
• Extending our flexible Plugin Architecture to install new capabilities into the system
• Open source collaboration in the OSS repo with high standards
• Shipping code rapidly with an unlimited token budget using agentic coding tools
• Improving reliability, observability, debuggability, and performance across NeMo Platform, SDKs, plugins, jobs, and workflows
• Building strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows

Skills

Python programming

System design

Distributed systems

Cloud-native services

Kubernetes

Strong communication

Leadership

Independence

Education

BS / MS in Computer Science, Computer Engineering, or related field

Tools

Kubernetes

Docker

Job description

NVIDIA is seeking a Senior Software Engineer to advance the NeMo Platform, a plugin-based AI platform for running and optimizing Agents at scale. You will join the Core team, shaping a flexible agent execution framework across local, Kubernetes, Slurm, and on‑prem environments.

You’ll lead design reviews, mentor teammates, and own core APIs for jobs, data, secrets, and RBAC. Expect rapid iterations, open-source collaboration, and high-performance goals.