Senior Software Engineer, NeMo Core Platform

NVIDIA Corporation; Santa Clara (CA); On-site; USD 184,000 - 357,000; Full time

Job summary

NVIDIA Corporation is hiring for a senior software engineering role in a fast-moving product research environment. You will lead design reviews, mentor engineers, and own complex cross-component problems, while building core APIs for running jobs, data storage, and RBAC.

The role requires deep Python expertise, distributed systems experience, and a track record with Kubernetes, Docker, and cloud-native architectures. Equity and comprehensive benefits are offered.

Qualifications

• BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field.
• 10+ years of professional software engineering experience building production systems.
• Comfort working in a very fast and ambiguous environment.
• Exceptional communication, both verbal and written.
• Strong system design skills with pragmatic flexibility and instincts for robust systems.
• Strong understanding of reliability, scalability, security, and performance tradeoffs in production infrastructure.
• Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration.
• Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design.
• Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces.
• Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries.

Responsibilities

• Working in a product research environment with fast iteration and ownership.
• Designing an Agentic Execution system adaptable to multiple environments (local, k8s, Slurm, on prem).
• Providing senior technical leadership through design and code reviews, mentoring, and cross-component problem ownership.
• Building and maintaining Core Platform APIs for running jobs, storing data, entities, secrets, and RBAC/auth.
• Extending a flexible Plugin Architecture for teams and external customers.
• Open-source development in NVIDIA's OSS repository with high standards.
• Shipping code rapidly with strong tooling and agentic coding practices.
• Improving reliability, observability, debuggability, and performance across NeMo Platform, SDKs, plugins, jobs, and workflows.
• Building strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows.

Skills

Python

Distributed systems

Cloud-native

Kubernetes

System design

Communication

Independent work

Education

BS/MS or equivalent

Tools

Kubernetes

Docker

Job description

What you\'ll be doing:

• Working in a product research environment where we place big bets on where the future is heading, adapting in real time as we build alongside an industry that is constantly evolving with us.


• This means fast iteration, high ownership, pragmatic decisions, and performance-minded implementation under production constraints


• Designing an Agentic Execution system that are flexible enough to work in many environments (local, k8s, Slurm, on prem / air-gapped)


• Provide senior technical leadership through design reviews, code reviews, mentoring, and ownership of ambiguous cross-component problems


• Building and maintain our Core Platform APIs for running jobs, storing data, entities, secrets, and RBAC and Auth


• Extending our flexible Plugin Architecture that makes it easy for many teams and external customers to install new capabilities into our system


• Building in the open in our OSS repo, keeping up the high standards that the open source community demands


• Shipping code at the speed of light with an unlimited token budget using best in class agentic coding tools


• Improving reliability, observability, debuggability, and performance across NeMo Platform, SDKs, plugins, jobs, and developer workflows


• Building strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows

What we need to see:

• BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field


• 10+ years of professional software engineering experience building production systems


• Comfort working in a very fast and ambiguous environment


• Exceptional communication, both verbal and written. This includes the ability to produce and review high quality architectural RFCs, and to discuss them clearly with the right level of technical detail for the right people (Engineer, Product, Marketing, etc.)


• Strong system design skills, with a pragmatic flexibility and phenomenal instincts to invent robust systems quickly without over-complicating.


• Strong understanding of reliability, scalability, security, and performance tradeoffs in production infrastructure


• Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration


• Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design


• Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces


• Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries

Ways to stand out from the crowd:

• Experience building, deploying, and iterating on production agentic AI systems at scale in Kubernetes


• Experience with sophisticated plugin architectures


• Strong ability to connect technical evaluation work to business outcomes, product quality, user experience, reliability, or operational efficiency


• Experience with enterprise AI systems where measurement, regression testing, observability, governance, and continuous improvement are required for production deployment

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until September 4, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer.

As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Learn more about NVIDIA.