Senior GPU Compute Infrastructure Engineer

LinuxCareers

United States

On-site

USD 170,000 - 250,000

Full time

39 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Highrise AI is a GPU-native infrastructure platform serving AI workloads at scale. We seek a Principal AI Infrastructure Engineer to bring large-scale GPU clusters from physical install to production readiness, providing deep expertise in cluster integration, bare-metal provisioning, and performance optimization.

You will lead the bring-up of racked AI clusters, validate BIOS/BMC, drivers, OS, and cluster software, and serve as senior escalation for complex production incidents affecting compute

Qualifications

  • Bachelor's degree in computer science, engineering, or related field, or equivalent practical experience.
  • 8+ years of hands-on Linux systems engineering, HPC, cloud, or large-scale infrastructure experience, including senior-level troubleshooting.
  • Proven experience bringing GPU or HPC clusters into production and qualifying systems against performance and reliability targets.
  • Strong expertise in Linux, automation (Python/Bash/Ansible), bare-metal provisioning, configuration management, and systems diagnostics.
  • Hands-on experience with NVIDIA GPU platforms, NCCL, Field Diagnostics, and multi-node performance testing.

Responsibilities

  • Lead technical bring-up of racked, powered, and cabled AI clusters through production readiness and customer handoff.
  • Establish and validate system baselines across BIOS/BMC, firmware, GPU drivers, operating systems, and cluster software stacks.
  • Deploy and optimize automated bare-metal provisioning, imaging, node configuration, and lifecycle workflows at scale.
  • Execute NVIDIA Field Diagnostics, L11/L12 validation, burn-in, stability, and hardware health qualification procedures.
  • Serve as senior escalation point for complex production incidents involving compute nodes, GPU software, provisioning, scheduling, and degraded performance.

Skills

Linux systems engineering
HPC
Troubleshooting
Automation
GPU compute

Education

Bachelor's degree or equivalent

Tools

Python
Bash
Ansible
NVIDIA NCCL
Bare-metal provisioning

Job description

Highrise AI is a GPU-native infrastructure platform serving AI workloads at scale. We seek a Principal AI Infrastructure Engineer to bring large-scale GPU clusters from physical install to production readiness, providing deep expertise in cluster integration, bare-metal provisioning, and performance optimization.

You will lead the bring-up of racked AI clusters, validate BIOS/BMC, drivers, OS, and cluster software, and serve as senior escalation for complex production incidents affecting compute

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Principal AI Infrastructure Engineer
Remote Principal AI Infrastructure Engineer

Hut 8 Corp. • United States

On-site
USD 180,000 - 260,000
Principal AI Infrastructure Engineer - Highrise AI
Principal AI Infrastructure Engineer - Highrise AI

LinuxCareers • United States

Remote
USD 170,000 - 250,000
Principal AI Systems Engineer - Large-Scale GPU Infra
Principal AI Systems Engineer - Large-Scale GPU Infra

Hut 8 Corp. • United States

On-site
USD 180,000 - 240,000
Principal AI Systems Engineer - HPC & GPU Infra
Principal AI Systems Engineer - HPC & GPU Infra

LinuxCareers • United States

On-site
USD 180,000 - 230,000
Senior AI Networking Architect — Large-Scale GPU Clusters
Senior AI Networking Architect — Large-Scale GPU Clusters

Hut 8 Corp. • United States

On-site
USD 180,000 - 280,000
AI Infrastructure Ops Engineer: GPU Compute & Storage
AI Infrastructure Ops Engineer: GPU Compute & Storage

LinuxCareers • United States

On-site
USD 90,000 - 130,000
Principal AI Systems Engineer - Highrise AI
Principal AI Systems Engineer - Highrise AI

LinuxCareers • United States

Remote
USD 180,000 - 230,000
Remote AI Infra Operations Engineer: Compute & Storage
Remote AI Infra Operations Engineer: Compute & Storage

Hut 8 Corp. • United States

On-site
USD 110,000 - 160,000
Hybrid/Remote work
AI Infrastructure Operations Engineer - Compute & Storage - Highrise AI
AI Infrastructure Operations Engineer - Compute & Storage - Highrise AI

LinuxCareers • United States

Remote
USD 90,000 - 130,000
Lead AI Cluster Networking Architect
Lead AI Cluster Networking Architect

LinuxCareers • United States

On-site
USD 180,000 - 240,000
NVIDIA networking tools