Remote AI Infra Ops Engineer - GPU Compute & Storage

Highrise AI; United States; Remote; USD 110,000 - 170,000; Full time

Job summary

Highrise AI is seeking a mid-level AI Infrastructure Operations Engineer to support large-scale GPU compute and storage clusters. You will troubleshoot Linux-based nodes, storage, and GPU health, and work with NOC, SRE, and data hall technicians to restore service.

The role involves a mix of incident management, provisioning, and automation, with hybrid/remote options depending on location and travel to data centers as needed.

Qualifications

• Bachelor's degree in computer science, engineering, or related field or equivalent hands-on experience.
• 3–6 years supporting Linux servers, HPC, cloud, or data center infrastructure in production.
• Experience with enterprise compute hardware, iDRAC/iLO or equivalent, and monitoring tools.
• Familiarity with NVIDIA GPUs, InfiniBand/RDMA, Kubernetes, Slurm, or AI storage platforms is a plus.
• Strong incident ownership, troubleshooting discipline, and documentation skills.

Responsibilities

• Own Tier 2 incidents and tickets, triage to resolution, and escalate when needed.
• Troubleshoot compute nodes, GPU health, storage, and related software in Linux environments.
• Support provisioning, reimaging, config changes, and validation using automation/runbooks.
• Investigate Kubernetes/Slurm failures and coordinate with Tier 3 engineers for root cause.
• Maintain assets, runbooks, and knowledge articles; improve repeatable operational tasks with scripts.

Skills

Linux

Bash

Python

Kubernetes

Slurm

NVIDIA GPUs

Storage systems

Troubleshooting

Education

Bachelor's degree in CS/Engineering

Tools

BMC/ipMI

iDRAC/iLO

Monitoring tools

Git/Bash scripting

Job description

Highrise AI is seeking a mid-level AI Infrastructure Operations Engineer to support large-scale GPU compute and storage clusters. You will troubleshoot Linux-based nodes, storage, and GPU health, and work with NOC, SRE, and data hall technicians to restore service.

The role involves a mix of incident management, provisioning, and automation, with hybrid/remote options depending on location and travel to data centers as needed.