Senior Software Engineer, Resilience Engineering - DGX Cloud

NVIDIA Corporation

United States

Remote

USD 184,000 - 357,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity eligibility
Comprehensive benefits package

Job summary

NVIDIA Corporation seeks an seasoned Reliability Engineer to lead org-wide reliability initiatives for 24/7 production environments in the United States. You will stand up SLO programs, guide incident response, and enhance production code and tooling for the data platform, applying chaos engineering and resilience practices.

The role requires 10+ years in industry and strong Go or Python skills, plus experience operating systems at scale. Equity and comprehensive benefits are available.

Qualifications

  • 10+ years of industry experience.
  • Hands-on experience running large-scale production systems.
  • Strong software engineering skills with Go or Python.
  • Proven ability to establish and maintain an SLO program.
  • Experience with chaos engineering and failure injection.

Responsibilities

  • Build org-wide reliability strategy for a 24/7 environment.
  • Stand up an SLO program with high standards across teams.
  • Lead incident response for high-severity incidents with low drama and high signal resolution.
  • Build and improve production code daily for the data platform and tooling.
  • Implement chaos engineering, failure injection, and resilience testing.
  • Influence across team boundaries through credibility and leadership.

Skills

Go
Python
Software engineering
SRE / Reliability
SLO program

Education

Bachelor's or Master's degree, or equivalent experience

Tools

Prometheus
OpenTelemetry
Grafana
PagerDuty
Rootly

Job description

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world.

What you’ll be doing
  • Build org-wide reliability strategy, guiding how NVIDIA matures its operational practices in a 24/7 environment.
  • Stand up a rigorous SLO program, defining and maintaining high standards across teams.
  • Lead incident response for high severity incidents, ensuring low drama and high signal resolution.
  • Build and improve production code daily, enhancing our data platform and related tooling.
  • Implement chaos engineering, failure injection, and resilience testing to elevate our team's standard practices.
  • Improve standards by setting an example with your hands-on experience and leadership.
What we need to see
  • Deep, hands-on experience running large-scale production systems with a proven track record.
  • A detailed understanding of failure modes in large systems, including cascading dependencies and retry storms.
  • Strong software engineering skills with current, hands-on experience in Go, Python, or similar languages.
  • Proven experience in establishing and maintaining an SLO program with operational rigor.
  • Practical experience in reliability fields such as chaos engineering and failure injection.
  • The ability to influence across team boundaries through credibility and expertise.
  • 10+ years of industry experience with a Bachelor's or Master's degree, or equivalent experience operating systems at scale.
Ways to stand out from the crowd
  • Experience within a world-class reliability function like Google SRE or Meta production engineering.
  • Expertise in operating GPU, HPC, or AI training infrastructure with outstanding failure modes.
  • A track record of measurable reliability improvements within an organization.
  • Proficiency with modern observability and operational tools like Prometheus, OpenTelemetry, Grafana, PagerDuty, and Rootly.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 184,000 USD - 287,500 USD for Level 4; and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 16, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, Resilience Engineering - DGX Cloud
Senior Software Engineer, Resilience Engineering - DGX Cloud

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Competitive benefits
Principal Software Engineer - DGX Cloud
Principal Software Engineer - DGX Cloud

NVIDIA Corporation • Seattle (WA)

On-site
USD 272,000 - 431,000
Equity
Benefits package
Senior Software Engineer - DGX Cloud
Senior Software Engineer - DGX Cloud

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 431,000
Equity
Benefits
Senior Site Reliability Engineer – Distributed Storage
Senior Site Reliability Engineer – Distributed Storage

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 188,000 - 442,000
Equity
Benefits package
Senior Site Reliability Engineer – Distributed Storage
Senior Site Reliability Engineer – Distributed Storage

NVIDIA Corporation • United States

Remote
USD 188,000 - 442,000
Senior Systems Performance Engineer
Senior Systems Performance Engineer

NVIDIA Corporation • California

On-site
USD 136,000 - 259,000
Equity
Benefits package
Senior Software Engineer, DGXC Data Services
Senior Software Engineer, DGXC Data Services

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 288,000
Equity
Benefits
Senior Software Engineer, Distributed Systems
Senior Software Engineer, Distributed Systems

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 158,000 - 364,000
Equity
Generous benefits package
Principal Software Engineer - DGX Cloud
Principal Software Engineer - DGX Cloud

NVIDIA Corporation • United States

On-site
USD 272,000 - 431,000
Equity
Benefits
Senior AI Infrastructure Engineer - DGX Cloud
Senior AI Infrastructure Engineer - DGX Cloud

NVIDIA Corporation • United States

Hybrid
USD 152,000 - 288,000
Equity
Benefits