Senior Manager, Software Engineering - Rack Scale Systems Infrastructure

NVIDIA

Santa Clara (CA)

On-site

USD 248,000 - 391,000

Full time

2 days ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA in Santa Clara is seeking a senior leader to own rack-scale infrastructure software delivery across hardware, firmware, networking, and operations teams. You will guide control planes, lifecycle orchestration, health monitoring, and recovery, while mentoring engineers and aligning cross-functional priorities, with equity and comprehensive benefits included.

This role requires strong technical leadership, strategic planning, and a track record of delivering production software in

Qualifications

  • Bachelor's, master's, or doctoral degree in Computer Science, Computer Engineering, Electrical Engineering, or related field, or equivalent experience.
  • 12+ years engineering experience in systems or data center software with 6+ years leading software/firmware teams.
  • Proven track record delivering production software across programs in a matrix org.
  • Strong Linux, distributed systems, APIs, state machines, failure handling experience.
  • Go, C++, or Rust development with ability to review designs and code.
  • Experience guiding distributed teams, recruiting engineers, and building technical leaders.
  • Clear written and verbal communication; ability to align teams and customers on practical solutions.

Responsibilities

  • Take ownership for rack-scale infra software delivery across cross-functional teams.
  • Translate hardware roadmaps into release priorities and plans.
  • Partner with architects on control planes, orchestration, health, and recovery.
  • Build and develop the team through hiring, mentoring, and setting expectations.
  • Establish planning, validation, release, and triage practices; drive root-cause resolution.

Skills

Leadership
Go
C++
Rust
Linux
Distributed systems
Communication
Mentoring
Project planning

Education

Bachelor's/Master's/PhD in CS/CE/EE

Tools

OpenBMC
Redfish
Kubernetes
NVLink
InfiniBand

Job description

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.


Join our team in Santa Clara to lead engineers building rack-scale infrastructure software that makes complex hardware manageable and programmable. You will own delivery of control planes, lifecycle orchestration, system health, and recovery capabilities, working across hardware, firmware, networking, and operations teams to support customer deployments at rack and fleet scale.


What you'll be doing:

  • Take ownership for the delivery of rack-scale infrastructure software within a cross-functional organizational structure. Coordinate commitments, address ownership gaps, and stay accountable for results from requirements to production adoption and support.
  • Translate business needs and evolving hardware roadmaps into release priorities and achievable plans. Balance staffing, dependencies, and technical risk across projects as priorities change.
  • Partner with architects and technical leads on control planes, lifecycle orchestration, health analysis, and recovery. Guide engineering tradeoffs and ensure a consistently high standard for reliability, security, and maintainability.
  • Build and develop the team through hiring, mentoring, and clear performance expectations. Grow technical leads and future managers, delegate important ownership, and balance work across the team.
  • Establish effective planning, validation, release, and issue triage practices. Use delivery and quality evidence to identify risks early, drive root-cause resolution of production issues, and improve how the team works.
  • Coordinate with firmware, platform, networking, quality assurance, security, and operations teams to deliver coordinated capabilities. Work directly with customers and partners to turn deployment feedback into product improvements.
  • Be responsible for the team's open-source delivery and support practices, including contribution review, issue triage, documentation, and release maintenance.
  • Communicate priorities, progress, and tradeoffs clearly to engineers, collaborators, and leadership. Make sound decisions in ambiguous situations and carry cross-team commitments through to completion.

What we need to see:

  • Bachelor's, master's, or doctoral degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience.
  • 12 or more overall years of engineering experience in systems software, platform software, server firmware, or data center infrastructure, including a minimum of 6 years managing software or firmware engineering teams.
  • Proven track record delivering production software across multiple programs in a matrix organization, aligning shared resources and dependencies while maintaining quality, release rigor, and effective production support.
  • Solid technical background in Linux, distributed systems, application programming interfaces, state machines, and failure handling. Familiarity with data center architecture, hardware-conscious orchestration, server manageability, firmware or operating system lifecycle, telemetry, and large-scale reliability.
  • Software development experience in Go, C++, or Rust, with the depth to review designs and code, guide debugging, and assess engineering quality.
  • Proven capability to guide distributed engineering groups, recruit and nurture engineers, cultivate technical leaders, assign significant responsibilities, and maintain a steady standard of performance.
  • Clear written and verbal communication, good judgment under ambiguity, and experience aligning engineering teams, customers, and partners on practical solutions.

Ways to stand out from the crowd:

  • Experience across the rack-scale systems lifecycle, from hardware bring-up and validation through provisioning, firmware and operating system updates, production operations, and recovery. Familiarity with NVIDIA GB200 or GB300 systems is a plus.
  • Experience with Kubernetes controllers or operators, declarative control planes, and simulation or fault injection to validate software before hardware is available.
  • Hands-on experience with baseboard management controller software, OpenBMC, embedded Linux, Python, and server debugging. Familiarity with Redfish or related standards for out-of-band management and device security, and with accelerated computing platforms using NVLink, Ethernet, or InfiniBand.
  • Built open-source infrastructure software used by external teams. Strong Rust experience and thoughtful use of artificial intelligence tools for development, testing, and debugging.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you!

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 248,000 USD - 391,000 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until October 16, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Manager, Software Engineering - Rack Scale Systems Infrastructure
Senior Manager, Software Engineering - Rack Scale Systems Infrastructure

NVIDIA • Seattle (WA)

On-site
USD 248,000 - 391,000
Equity
Benefits
Senior Manager, Software Engineering - Rack Scale Systems Infrastructure
Senior Manager, Software Engineering - Rack Scale Systems Infrastructure

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 248,000 - 391,000
Principal Software Engineer, Rack-Scale System Software — CSP Engagements
Principal Software Engineer, Rack-Scale System Software — CSP Engagements

NVIDIA • California (MO)

On-site
USD 272,000 - 431,250
Equity
Comprehensive benefits package
Principal Software Engineer, Rack-Scale System Software — CSP Engagements
Principal Software Engineer, Rack-Scale System Software — CSP Engagements

NVIDIA Corporation • Santa Clara (CA), Northern (KY)

On-site
USD 272,000 - 431,000
Equity
Benefits
Principal Software Engineer, Rack-Scale System Software — CSP Engagements
Principal Software Engineer, Rack-Scale System Software — CSP Engagements

NVIDIA • Oregon (WI)

On-site
USD 272,000 - 431,250
Equity
Benefits
Principal Software Engineer - Compute Infrastructure
Principal Software Engineer - Compute Infrastructure

NVIDIA • Santa Clara (CA)

On-site
USD 248,000 - 391,000
Equity
Benefits
Senior Manager, Compute Core Engineering
Senior Manager, Compute Core Engineering

NVIDIA • Santa Clara (CA)

On-site
USD 248,000 - 391,000
Equity
Benefits
Principal Software Engineer
Principal Software Engineer

NVIDIA • Redmond (WA)

On-site
USD 272,000 - 431,000
Equity
Benefits
Senior System Software Engineer - Embedded Controller
Senior System Software Engineer - Embedded Controller

NVIDIA • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Director, Software Engineering – Cloud Compute and Infrastructure
Director, Software Engineering – Cloud Compute and Infrastructure

NVIDIA • Santa Clara (CA)

On-site
USD 320,000 - 489,000
Equity