AI Infrastructure Ops Engineer: GPU Compute & Storage

LinuxCareers; United States; On-site; USD 90,000 - 130,000; Full time

Job summary

Highrise AI is seeking a mid-level AI Infrastructure Operations Engineer to own escalated incidents, restore services, and maintain reliable production AI cluster operations. You will diagnose and resolve issues across Linux servers, GPU health, and distributed storage, while coordinating with Tier 3 when needed.

The role emphasizes automation, runbooks, and scripting to reduce recurring incidents. Ideal candidates have 3–6 years in Linux/HPC environments, experience with iDRAC/iLO, and

Qualifications

• Bachelor's degree or equivalent hands-on experience in CS/engineering.
• 3–6 years of production Linux/HPC experience.
• Experience troubleshooting enterprise compute hardware and BMC interfaces.

Responsibilities

• Own and manage escalated incidents, service requests, and problem tickets from triage through resolution or handoff.
• Diagnose compute and storage faults using system logs, dashboards, and diagnostic tools; coordinate restoration within SLA targets.
• Troubleshoot Linux servers, GPU health alerts, boot failures, firmware/driver issues, and resource availability; support provisioning and maintenance via automation.
• Investigate Kubernetes and Slurm node or workload failures; monitor distributed storage systems for capacity and throughput.
• Assist with upgrades, maintenance, and expansions; maintain runbooks and automate repeatable tasks with scripts.

Skills

Linux servers

HPC / high-performance computing

Cloud infrastructure

Data center infrastructure

Troubleshooting

Bash scripting

Python scripting

Ticketing / change management

Education

Bachelor's degree in computer science, engineering, or related discipline

Tools

BMC interfaces (iDRAC/iLO)

Monitoring tools

NFS

Distributed filesystems

Object storage

Job description

Highrise AI is seeking a mid-level AI Infrastructure Operations Engineer to own escalated incidents, restore services, and maintain reliable production AI cluster operations. You will diagnose and resolve issues across Linux servers, GPU health, and distributed storage, while coordinating with Tier 3 when needed.

The role emphasizes automation, runbooks, and scripting to reduce recurring incidents. Ideal candidates have 3–6 years in Linux/HPC environments, experience with iDRAC/iLO, and