Senior HPC AI Cluster Engineer

NVIDIA Corporation; Santa Clara (CA); On-site; USD 176,000 - 334,000; Full time

Job summary

NVIDIA is seeking an experienced HPC-AI Engineer to join the Networking Clusters Solutions Infrastructure team in Santa Clara, CA. You will design and operate large-scale HPC/AI clusters, develop CI/CD pipelines, and automate deployment of infrastructure to support cutting-edge GPU computing and AI research.

You will collaborate with HPC, OS, GPU compute and systems teams, work with Slurm, Kubernetes, and cloud platforms, and help define standard methodologies for scalable performance platforms.

Qualifications

• 8+ years of experience in HPC/AI infrastructure.
• Knowledge of HPC/AI tech from CPUs to high-speed interconnects and supporting software.
• Experience with Slurm, Kubernetes and cloud platforms (AWS, Azure, Google).

Responsibilities

• Design, implement and maintain large scale HPC/AI clusters with monitoring, logging and alerting
• Manage Linux job/workload schedules and orchestration tools
• Develop and maintain continuous integration and delivery pipelines
• Develop tooling to automate deployment and management of large-scale infrastructure environments
• Deploy monitoring solutions for the servers, network and storage
• Perform troubleshooting bottom up from bare metal, operating system, software stack and application level
• Share standard methodologies with internal teams and support R&D activities

Skills

HPC/AI systems

Slurm

Kubernetes

Linux networking

Python & Bash

Automation tools

InfiniBand/Ethernet

Virtualization

Cloud platforms

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Slurm

Kubernetes

VMware/Hyper-V/KVM

Job description

NVIDIA is looking for an experienced HPC-AI Engineer to join the Networking Clusters Solutions Infrastructure team. We are focused on building supercomputers and AI clusters based on groundbreaking technologies. We are looking for an outstanding engineer, be a key player to the most exciting computing hardware and software to contribute to the latest breakthroughs in artificial intelligence and GPU computing. Provide insights on at-scale system design and tuning mechanisms for large-scale compute runs. You will work with the latest Accelerated computing and Deep Learning software and hardware platforms, and with many scientific researchers, developers, and customers to craft improved workflows and develop new, leading differentiated solutions. You will interact with HPC, OS, GPU compute, and systems specialist to architect, develop and bring up large scale performance platforms.

What you will be doing

• Design, implement and maintain large scale HPC/AI clusters with monitoring, logging and alerting
• Manage Linux job/workload schedules and orchestration tools
• Develop and maintain continuous integration and delivery pipelines
• Develop tooling to automate deployment and management of large-scale infrastructure environments, to automate operational monitoring and alerting, and to enable self-service consumption of resources
• Deploy monitoring solutions for the servers, network and storage
• Perform troubleshooting bottom up from bare metal, operating system, software stack and application level
• Being a technical resource, develop, re-define and document standard methodologies to share with internal teams
• Support Research & Development activities and engage in POCs/POVs for future improvements

What we need to see

• A degree in Computer Science, Engineering, or a related field (or equivalent experience) and 8+ years of experience
• Knowledge of HPC and AI solution technologies from CPU’s and GPU’s to high speed interconnects and supporting software
• Experience with job scheduling workloads and orchestration tools such as Slurm, K8s
• Excellent knowledge of Windows and Linux (Redhat/CentOS and Ubuntu) networking (sockets, firewalld, iptables, wireshark, etc.) and internals, ACLs and OS level security protection and common protocols e.g. TCP, DHCP, DNS, etc.
• Experience with multiple storage solutions such as Lustre, GPFS, Weka.io. Familiarity with newer and emerging storage technologies.
• Python programming and bash scripting experience
• Comfortable with automation and configuration management tools such as Jenkins, Ansible, Puppet/chef
• Deep knowledge of Networking Protocols like InfiniBand, Ethernet
• Deep understanding and experience with virtual systems (for example VMware, Hyper-V, KVM, or Citrix)
• Familiarity with cloud computing platforms (e.g. AWS, Azure, Google Cloud)

Ways to stand out from the crowd

• Knowledge of CPU and/or GPU architecture
• Knowledge of Kubernetes, container related microservice technologies
• Experience with GPU-focused hardware/software (DGX, Cuda)
• Experience with RDMA (InfiniBand or RoCE) fabrics

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 176,000 USD - 276,000 USD for Level4, and 208,000 USD - 333,500 USD for Level5. You will also be eligible for equity and benefits.

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you’re a creative and autonomous engineer with a real passion for technology, we want to hear from you.

Applications for this job will be accepted at least until August24, 2026.

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA.