Senior Software Engineer, SRE and Production Engineering - DGX Cloud NVIDIA · US, CA, Santa Clara · Site Reliability In listing 2w ago

Devopsroles; Santa Clara (CA); On-site; USD 152,000 - 288,000; Full time

Benefits offered by this job

Equity

Comprehensive benefits

Job summary

NVIDIA is seeking software engineers with SRE or Production Engineering experience to help operate and scale our BMaaS/IaaS infrastructure for GPU systems.

You will build automation for bare-metal provisioning, hardware validation, firmware upgrades, and cluster lifecycle, while diagnosing complex issues across Linux, Kubernetes, and hardware. On-call duties and cross-team collaboration are expected. Experience with BMC/Redfish is highly valued.

Qualifications

• 5+ years building software for or operating production infrastructure.
• Strong Go or Python skills with production automation experience.
• Direct experience with BMC and Redfish in server provisioning or health checks.
• Hands-on with NVIDIA GPU hardware (NVL72) and BlueField DPUs.
• Experience with Linux, firmware/driver management, and Kubernetes.
• On-call experience, incident response, and durable reliability solutions.

Responsibilities

• Build automation for bare-metal provisioning, hardware validation, upgrades, repair, and lifecycle management.
• Develop tools interacting with BMC and Redfish to monitor health and manage state.
• Handle NVL72 systems and BlueField DPUs across cloud and on‑prem environments.
• Diagnose failures across servers, DPUs, GPU/CPU, networking, Linux, and Kubernetes; automate fixes.
• Define validation criteria to bring new capacity into production safely.
• Participate in on-call duties, incident response, and root-cause analyses with follow-ups.

Skills

Go

Python

Linux

On-call / SRE

Observability

Distributed systems

Networking

Education

BS/MS in Computer Science or equivalent

Tools

BMC

Redfish

NVIDIA NVL72

BlueField-3

Kubernetes

Job description

NVIDIA DGX Cloud builds and operates large-scale GPU infrastructure for AI workloads. We are looking for Software Engineers with SRE or Production Engineering experience who have worked hands-on with bare-metal NVIDIA systems. This team builds the software and operational tooling that moves GPU capacity from installed hardware to production service supporting an IaaS production environment of BMaaS, VMaaS.

What you’ll be doing

• Build automation for bare-metal provisioning, hardware validation, firmware and software upgrades, repair, and cluster lifecycle management.
• Develop tools that interact with BMC and Redfish interfaces to monitor hardware health, manage server state, and assist recovery workflows.
• Handle and advance NVIDIA NVL72 systems and BlueField-3 or later DPUs throughout cloud partner and on-premises environments.
• Diagnose failures across servers, DPUs, GPU systems, CPU systems, networking, Linux, and Kubernetes; turn recurring issues into automated detection and repair.
• Define validation and handoff criteria so new capacity enters production safely and consistently.
• Take part in on-call duties, incident response, root-cause analysis, and follow-up to implement permanent solutions.
• Work with hardware, networking, platform, data center operations, and partner teams to resolve issues across ownership boundaries.

What we need to see:

• 5+ years building software for or operating production infrastructure, including substantial hands-on bare-metal experience.
• Strong Go or Python skills, with a record of delivering production automation and services.
• Direct experience with BMC and Redfish in server provisioning, health inspection, power management, or fault diagnosis.
• Practical experience working directly with NVIDIA GPU hardware, such as NVL72 systems, and BlueField-3 or newer DPUs.
• Experience with Linux, firmware and driver management, network boot, and the server lifecycle from initial provisioning through repair.
• Experience managing production reliability through on-call duties, incident response, observability, and durable solutions.
• Ability to debug failures across hardware, host operating systems, networking, and distributed services.
• Clear communication and demonstrated ownership of problems that span multiple teams.
• BS/MS in Computer Science or equivalent experience in a practical setting.

Ways to stand out from the crowd:

• Experience operating BlueField DPUs in DPU mode, including host-to-DPU connectivity and lifecycle debugging, with DPU or equivalent experience considered.
• Background with NVLink, InfiniBand, Spectrum-X, or GPU cluster performance validation.
• Experience building safe, repeatable workflows for rack-scale bringup, firmware upgrades, hardware replacement, and customer handoff.
• Experience with Kubernetes, GitOps, Argo CD, SLOs, and fleet-wide automation.

At NVIDIA, you’ll help make next-generation AI infrastructure production-ready at scale!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 3, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.