Principal AI Systems Engineer, GPU Compute Infra

Highrise AI

United States

Hybrid

USD 180,000 - 280,000

Full time

14 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Highrise AI seeks a principal-level AI Systems Engineer to design, deploy, integrate, and operate scalable GPU compute infrastructure for large AI workloads. You will work with senior engineers on general-purpose compute, virtualization, storage, identity, and security platforms from initial install to production handoff.

Responsibilities include deployment, validation, and Tier 3 incident escalation, plus continuous optimization of high-uptime AI clusters across multiple sites.

Qualifications

  • Bachelor's degree or equivalent practical experience in CS/engineering/IT.
  • 10+ years building and operating enterprise, cloud, HPC, or large-scale data-center infra.
  • Expert Linux administration, automation, and infra integration skills.
  • Experience with x86 platforms, virtualization, and automated provisioning.
  • Hands-on with high-performance or distributed storage (WEKA/VAST preferred).
  • Strong DNS/DHCP/IPAM, identity management (SSO, RBAC), and core services knowledge.
  • Experience in AI/HPC clusters and security/compliance infrastructure.

Responsibilities

  • Lead deployment and configuration of general-purpose x86 servers and Linux OS.
  • Design, deploy, and manage virtualized infrastructure (VMware, KVM, Proxmox).
  • Implement automated bare-metal provisioning, imaging, firmware mgmt, and config workflows.
  • Deploy core services (DNS, DHCP, NTP, IPAM, DCIM like Infoblox/NetBox).
  • Establish standards, baselines, and scalable deployment procedures for AI clusters.
  • Lead integration testing and production handoff for large-scale compute infra.
  • Provide Tier 3 support, advanced troubleshooting, and ongoing optimization.

Skills

Linux systems administration
Virtualization technologies
Distributed storage
DNS / DHCP / IPAM / RBAC
Automation: Ansible / Terraform / PyTh
Security & compliance infrastructure
AI/HPC cluster experience

Education

Bachelor's degree in CS/Engineering/IT
10+ years enterprise infra experience

Tools

WEKA
VAST Data
Infoblox
NetBox
VMware / KVM / Proxmox

Job description

Highrise AI seeks a principal-level AI Systems Engineer to design, deploy, integrate, and operate scalable GPU compute infrastructure for large AI workloads. You will work with senior engineers on general-purpose compute, virtualization, storage, identity, and security platforms from initial install to production handoff.

Responsibilities include deployment, validation, and Tier 3 incident escalation, plus continuous optimization of high-uptime AI clusters across multiple sites.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI GPU Infrastructure Lead
Senior AI GPU Infrastructure Lead

Highrise AI • United States

Remote
USD 140,000 - 200,000
Lead AI Compute Infrastructure Engineer
Lead AI Compute Infrastructure Engineer

Highrise AI • United States

Remote
USD 120,000 - 180,000
Principal AI Systems Engineer (Fully Remote)
Principal AI Systems Engineer (Fully Remote)

Highrise AI • United States

Remote
USD 120,000 - 180,000
AI Infra Ops Engineer: Compute & Storage
AI Infra Ops Engineer: Compute & Storage

Remote • San Francisco (CA)

Hybrid
USD 120,000 - 160,000
Hybrid work option
Training & growth opportunities
GPU Infrastructure Operations Engineer (Hybrid/Remote)
GPU Infrastructure Operations Engineer (Hybrid/Remote)

Highrise AI • United States

Hybrid
USD 90,000 - 130,000
AI Infrastructure Architect — Scalable GPU Compute
AI Infrastructure Architect — Scalable GPU Compute

EngineersOfAI • Sunnyvale (CA)

On-site
USD 150,000 - 200,000
Senior GPU Cluster Architect for AI Infra at Scale
Senior GPU Cluster Architect for AI Infra at Scale

Partner Company • United States

Remote
USD 184,000 - 318,000
Medical insurance
Dental insurance
Vision insurance
+1
Senior AI GPU Infra Architect (Remote, Hyperscale HPC)
Senior AI GPU Infra Architect (Remote, Hyperscale HPC)

5C Group • United States

Remote
USD 120,000 - 150,000
Principal AI/ML Infra Engineer, GPU Clusters
Principal AI/ML Infra Engineer, GPU Clusters

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 272,000 - 431,000
Equity
Comprehensive benefits
Principal AI/ML Infra Architect - GPU Clusters (Equity)
Principal AI/ML Infra Architect - GPU Clusters (Equity)

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 272,000 - 431,000
Equity
Benefits
Competitive salary