Distinguished Engineer - Rack Scale Architecture

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 320,000 - 488,750; Full time

Job summary

NVIDIA Gruppe in Santa Clara is seeking a highly motivated technical leader to drive the engineering roadmap for their rack system software architecture. You will engage with industry-leading hyperscalars and manage software across various platforms while mentoring teams.

The position demands extensive experience in system architecture and networking protocols, with responsibilities including consulting with major clients to ensure alignment with NVIDIA's objectives. A competitive salary ranging from $320,000 to $488,750 USD is offered, along with equity and additional benefits.

Qualifications

• 15+ years in the area of system architecture and design.
• Deep experience in designing architecture for scalable and performant server systems.
• Strong understanding of networking technology & protocols.

Responsibilities

• Drive the software end-to-end architecture for NVIDIA’s rack-scale products.
• Ensure high quality & reliable software; serve as an architectural partner.
• Work directly with major customers to align their roadmap with NVIDIA’s.

Skills

System architecture and design

Networking technology & protocols knowledge

Communication skills

Education

BS or MS degree in Computer Engineering, Computer Science

Job description

Company Overview

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work.

Role Overview

We’re searching for a highly motivated, technical leader to drive the engineering roadmap and innovation for our rack system software architecture. From firmware, kernel drivers, operating systems, networking, fabrics and associated user mode drivers + manageability software. You will work with component leads internally and engage with industry leading hyperscalar / cloud service providers on taking these products to market.

Responsibilities

• Drive the software end‑to‑end architecture for NVIDIA’s rack‑scale products
• Maintain deep understanding of the product portfolio and roadmap; translate forward‑looking plans into clear, formal software requirements that anchor execution across the organization
• Ensure high quality & reliable software; serving as a trusted architectural partner to teams requiring guidance or oversight
• Work directly with major customers to understand their requirements and work to align their roadmap with NVIDIA’s roadmap
• Work with business partners and vendors to shape their products to meet NVIDIA’s needs
• Develop a roadmap of new technologies and protocols; drive their design and adoption
• Mentor architects and engineering teams to grow them into future leaders
• Make key technical decisions even when faced with ambiguity

Qualifications

• BS or MS degree in Computer Engineering, Computer Science, or related degree or equivalent experience
• 15+ years in the area of system architecture and design
• Deep experience in designing architecture for scalable and performant server systems, particularly at the SW/HW interface
• Strong understanding of networking technology & protocols (e.g., Ethernet, Infiniband)
• Previous experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAs
• Expertise in out‑of‑band and in‑band management architectures
• Knowledge of system management protocols such as Redfish and IPMI
• Experience working with platform security experts to define tradeoffs between security and ease of use
• Demonstrable experience in implementing left shift strategy to de‑risk program execution
• Excellent written and verbal communication skills

Ways to Stand Out

• Knowledge of large‑scale cloud and cluster level deployment and management systems. Experience with designing robust, resilient and performant scale‑up fabrics
• Demonstrated track record of leading data centre products across the entire lifecycle, spanning inception, pre‑silicon development, post‑silicon bring‑up, manufacturing, and deployment
• Familiarity with CXL, UCIE and other C2C technology architectures. Knowledge in storage and networking technologies

Benefits and Compensation

Base salary range: 320,000 USD – 488,750 USD.
Equity and additional benefits are available.

Application Period

This position is open until June 1, 2026. Applications are accepted at least until that date.

EEO Statement

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.