Senior Datacenter Technical Program Manager, At-Scale AI Clusters

NVIDIA

United States

Remote

USD 168,000 - 322,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA is seeking an experienced HPC engineer to collaborate with engineers and architects to design, deploy, and manage large-scale GPU computing systems in on-premises datacenters. The role emphasizes close interaction with multiple teams to ensure robust integration of AI clusters with power, cooling, and instrumentation requirements.

The ideal candidate has a BS in engineering, 8+ years in HPC and GPU clusters, and a passion for solving complex problems.

Qualifications

  • BS in Applied Science or Engineering (or equivalent experience).
  • 8+ years of overall experience.
  • Experience with high-performance computing systems and GPU clusters deployed in on-premises datacenters.
  • A passion for understanding challenging technical problems and driving the process of finding a solution.
  • Strong teamwork and interpersonal skills, to facilitate building a collaborative workflow for coordination between many teams.

Responsibilities

  • Collaborate with outstanding engineers and architects to build and deploy large scale GPU computing systems based on NVIDIA 's reference supercomputing architectures
  • Lead the integration of new AI clusters with datacenter facilities with demanding requirements on power, cooling, and instrumentation
  • Coordinate design and fit-out of new datacenter builds, working with both internal engineering teams and external contractors
  • Own and produce detailed documentation for the end-to-end process for datacenter fit-out and integration
  • Communicate internally with engineering leadership to prioritize and address key issues essential to the success of our largest customers

Skills

High-performance computing
GPU clusters
Team coordination
Documentation

Education

BS in Applied Science or Engineering

Tools

Prometheus
Grafana
Splunk
Modbus
BACNet

Job description

What you’ll be doing:
  • Collaborate with outstanding engineers and architects to build and deploy large scale GPU computing systems based on NVIDIA 's reference supercomputing architectures
  • Lead the integration of new AI clusters with datacenter facilities with demanding requirements on power, cooling, and instrumentation
  • Coordinate design and fit-out of new datacenter builds, working with both internal engineering teams and external contractors
  • Own and produce detailed documentation for the end-to-end process for datacenter fit-out and integration
  • Communicate internally with engineering leadership to prioritize and address key issues essential to the success of our largest customers
What we need to see:
  • BS in Applied Science or Engineering (or equivalent experience)
  • 8+ years of overall experience
  • Experience with high-performance computing systems and GPU clusters deployed in on-premises datacenters
  • A passion for understanding challenging technical problems and driving the process of finding a solution
  • Strong teamwork and interpersonal skills, to facilitate building a collaborative workflow for coordination between many teams
Ways to stand out from the crowd:
  • Understanding of datacenter design, including familiarity with power and cooling technologies
  • Expertise in system monitoring and instrumentation of large clusters, using technologies such as Prometheus, Grafana, Splunk, Modbus, and BACNet
  • Experience working with the engineering or academic research community supporting high-performance computing or deep learning

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 258,750 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until August 4, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Originally posted on Himalayas

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Datacenter Technical Program Manager, At-Scale AI Clusters
Senior Datacenter Technical Program Manager, At-Scale AI Clusters

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 168,000 - 322,000
Equity
Benefits
Senior HPC-AI Cluster Architect (Equity)
Senior HPC-AI Cluster Architect (Equity)

NVIDIA Corporation • California

On-site
USD 176,000 - 334,000
Senior AI Infrastructure Architect for GPU Clusters
Senior AI Infrastructure Architect for GPU Clusters

NVIDIA Corporation • California

On-site
USD 184,000 - 356,500
Senior Manager, AI and HPC Cluster Engineering Enablement
Senior Manager, AI and HPC Cluster Engineering Enablement

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 272,000 - 489,000
Equity
Senior Solutions Architect - Cluster Design and Architecture
Senior Solutions Architect - Cluster Design and Architecture

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior Solutions Architect, AI Compute – NPN
Senior Solutions Architect, AI Compute – NPN

NVIDIA Corporation • California

On-site
USD 184,000 - 357,000
Equity
Benefits
AI/HPC Solutions Architect - Deploy & Scale Large Systems
AI/HPC Solutions Architect - Deploy & Scale Large Systems

NVIDIA Corporation • Texas

On-site
USD 148,000 - 235,750
Equity
Benefits
Senior HPC AI Cluster Engineer
Senior HPC AI Cluster Engineer

NVIDIA Corporation • California

On-site
USD 176,000 - 334,000
Solutions Architect, Data Center Infrastructure
Solutions Architect, Data Center Infrastructure

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 120,000 - 286,000
Equity
Benefits
Senior Software Engineer - DGX Cloud
Senior Software Engineer - DGX Cloud

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 431,000
Equity
Benefits