AI Infrastructure Operations Engineer - Compute & Storage - Highrise AI

LinuxCareers; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

Highrise AI is seeking a mid-level AI Infrastructure Operations Engineer to own escalated incidents, restore services, and maintain reliable production AI cluster operations. You will diagnose and resolve issues across Linux servers, GPU health, and distributed storage, while coordinating with Tier 3 when needed.

The role emphasizes automation, runbooks, and scripting to reduce recurring incidents. Ideal candidates have 3–6 years in Linux/HPC environments, experience with iDRAC/iLO, and

Qualifications

• Bachelor's degree or equivalent hands-on experience in CS/engineering.
• 3–6 years of production Linux/HPC experience.
• Experience troubleshooting enterprise compute hardware and BMC interfaces.

Responsibilities

• Own and manage escalated incidents, service requests, and problem tickets from triage through resolution or handoff.
• Diagnose compute and storage faults using system logs, dashboards, and diagnostic tools; coordinate restoration within SLA targets.
• Troubleshoot Linux servers, GPU health alerts, boot failures, firmware/driver issues, and resource availability; support provisioning and maintenance via automation.
• Investigate Kubernetes and Slurm node or workload failures; monitor distributed storage systems for capacity and throughput.
• Assist with upgrades, maintenance, and expansions; maintain runbooks and automate repeatable tasks with scripts.

Skills

Linux servers

HPC / high-performance computing

Cloud infrastructure

Data center infrastructure

Troubleshooting

Bash scripting

Python scripting

Ticketing / change management

Education

Bachelor's degree in computer science, engineering, or related discipline

Tools

BMC interfaces (iDRAC/iLO)

Monitoring tools

NFS

Distributed filesystems

Object storage

Job description

Highrise AI is a GPU-native infrastructure platform for modern AI workloads, combining bare-metal performance with full-stack orchestration and hardware-enforced isolation. This role is a mid-level AI Infrastructure Operations Engineer providing Tier 2 operational support for large-scale GPU compute and storage platforms, focusing on owning technical tickets, restoring service, and maintaining reliable production AI cluster operations.

What You'll Do

• Own and manage escalated incidents, service requests, and problem tickets from initial triage through resolution or documented handoff to Tier 3
• Diagnose compute and storage faults using system logs, monitoring dashboards, management interfaces, and diagnostic tools; assess severity and coordinate service restoration within SLA targets
• Troubleshoot Linux servers, GPU health alerts, boot failures, firmware/driver issues, and resource availability problems; support node provisioning, reimaging, and maintenance using automation and runbooks
• Investigate Kubernetes and Slurm node or workload failures; monitor and troubleshoot distributed and high-performance storage systems including capacity, throughput, and client connectivity
• Assist with upgrades, planned maintenance, and cluster expansions; maintain accurate records and improve runbooks; identify recurring incidents and automate repeatable operational work with scripts

What You Need

• Bachelor's degree in computer science, engineering, or related discipline, or equivalent hands-on experience
• 3–6 years of experience supporting Linux servers, HPC, cloud, or data center infrastructure in a production environment
• Practical troubleshooting experience with enterprise compute hardware, BMC interfaces (iDRAC/iLO or equivalent), and monitoring tools
• Working familiarity with storage technologies such as NFS, distributed filesystems, and object storage
• Experience using ticketing systems, change management procedures, and Bash or Python scripting for diagnostics and automation

Nice to Have

• Exposure to NVIDIA GPU systems, InfiniBand/RDMA, Kubernetes, Slurm, or AI/HPC storage platforms
• Experience with Linux distribution management and advanced system administration
• Familiarity with data center operations and hardware commissioning workflows