Director, Rack Scale Software Architecture

NVIDIA Corporation

Santa Clara (CA)

On-site

USD 320,000 - 489,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Equity

Job summary

NVIDIA is seeking a highly technical, motivated manager to lead and manage the team responsible for rack‑scale system software architecture.

The role will drive the software end‑to‑end architecture for NVIDIA’s rack‑scale products, translate forward‑looking plans into clear, formal software requirements, and provide technical leadership and career mentorship while ensuring high quality and reliable software.

Qualifications

  • 15+ years in system architecture and design with 8+ years in management.
  • Deep experience designing scalable, performant server architectures at the SW/HW interface.
  • Proven leadership with ownership on large-scale code bases.
  • Experience with accelerators such as GPUs, DPUs or FPGAs.
  • Excellent communication, problem solving and mentoring skills.

Responsibilities

  • Drive end-to-end software architecture for NVIDIA's rack-scale products.
  • Translate forward-looking plans into formal software requirements anchoring execution.
  • Ensure high quality and reliable software; act as a trusted architectural partner.
  • Collaborate with major customers to align their roadmap with NVIDIA’s roadmap.
  • Present the team vision to senior NVIDIA and external leaders with strong communication.
  • Provide technical leadership and career mentorship to the team.
  • Make key technical decisions even when faced with ambiguity.

Skills

Leadership
Communication
Problem solving
Critical thinking
Mentorship
Matrixed environment

Education

BS/MS in Computer Engineering/CS

Job description

NVIDIA is searching for a highly technical, motivated manager to lead and manage the team responsible for rack‑scale system software architecture. The role will drive the software end‑to‑end architecture for NVIDIA’s rack‑scale products, translate forward‑looking plans into clear, formal software requirements, and provide technical leadership and career mentorship while ensuring high quality and reliable software.

Responsibilities
  • Drive the software end‑to‑end architecture for NVIDIA's rack-scale products
  • Maintain deep understanding of the product portfolio and roadmap; translate forward‑looking plans into clear, formal software requirements that anchor execution across the organization
  • Ensure high quality & reliable software; serve as a trusted architectural partner to teams requiring guidance or oversight
  • Work directly with major customers to understand their requirements and align their roadmap with NVIDIA’s roadmap
  • Present the team vision to senior NVIDIA and external leaders using strong communication skills
  • Provide technical leadership and career mentorship to the team
  • Make key technical decisions even when faced with ambiguity
Qualifications
  • BS or MS degree in Computer Engineering, Computer Science, or related degree (or equivalent experience)
  • 15+ overall years of experience in the area of system architecture and design with 8+ years in management
  • Deep experience in designing architecture for scalable and performant server systems, especially at the SW/HW interface
  • Proven leadership skills and strong ownership on past projects involving a large-scale sophisticated code base
  • Previous experience working with complex system software for accelerators such as GPUs, DPUs, or FPGAs
  • Strong managerial, problem‑solving and critical‑thinking skills
  • Comfortable operating in highly matrixed organizations while holding a leadership position
  • Excellent verbal and written communication skills
Ways to Stand Out
  • Knowledge of large‑scale cloud and cluster‑level deployment and management systems; experience designing robust, resilient and performant scale‑up fabrics
  • Demonstrated track record of leading data center products across the entire lifecycle, spanning inception, pre‑silicon development, post‑silicon bring‑up, manufacturing, and deployment
  • Strong understanding of networking technology & protocols (e.g., Ethernet, Infiniband); familiarity with CXL, UCIE and other C2C technology architectures; knowledge of storage and networking technologies
Salary & Benefits

Base salary range: 320,000USD – 488,750USD. Eligible for equity and benefits.

Equal Opportunity Employer

NVIDIA is committed to fostering an inclusive work environment and is proud to be an equal‑opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Distinguished Engineer - Rack Scale Architecture
Distinguished Engineer - Rack Scale Architecture

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 320,000 - 488,750
Distinguished Engineer - Rack Scale Architecture
Distinguished Engineer - Rack Scale Architecture

NVIDIA • Boulder (CO)

On-site
USD 320,000 - 488,750
Distinguished Engineer - Rack Scale Architecture
Distinguished Engineer - Rack Scale Architecture

NVIDIA • Redmond (WA)

On-site
USD 320,000 - 488,750
Equity
Benefits
Distinguished Engineer - Rack Scale Architecture
Distinguished Engineer - Rack Scale Architecture

NVIDIA • Durham (NC)

On-site
USD 320,000 - 488,750
Rack-Scale Systems Engineer: Equity & Impact
Rack-Scale Systems Engineer: Equity & Impact

NVIDIA • Austin (TX)

On-site
USD 184,000 - 287,500
Equity
Comprehensive benefits package
Senior Software Engineer - Manufacturing and Factory
Senior Software Engineer - Manufacturing and Factory

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 184,000 - 356,500
Principal Software Engineer, Rack-Scale System Software — CSP Engagements
Principal Software Engineer, Rack-Scale System Software — CSP Engagements

NVIDIA Corporation • Santa Clara (CA), Northern (KY)

On-site
USD 272,000 - 431,000
Equity
Benefits
Distinguished Engineer – Data Center System Software Architect
Distinguished Engineer – Data Center System Software Architect

Segment (Twilio) • Santa Clara (CA)

On-site
USD 320,000 - 488,750
Equity
Benefits
Manager, Solutions Architecture – GPU and Networking Systems
Manager, Solutions Architecture – GPU and Networking Systems

NVIDIA • Santa Clara (CA)

Remote
USD 224,000 - 431,000
Equity
Benefits
Remote work option
Principal Software Engineer, Rack-Scale System Software — CSP Engagements
Principal Software Engineer, Rack-Scale System Software — CSP Engagements

NVIDIA • Oregon (WI)

On-site
USD 272,000 - 431,250
Equity
Benefits