Remote AI Infrastructure Operations Engineer

Highrise AI; United States; Hybrid; USD 90,000 - 130,000; Full time

Job summary

Highrise AI is seeking a mid-level AI Infrastructure Operations Engineer to provide Tier 2 support for large-scale GPU compute and storage platforms. You will own technical tickets, diagnose issues, and ensure reliable day-to-day operation across production clusters.

Work with NOC, on-site technicians, SRE teams, and Tier 3 engineers to resolve problems, while contributing to automation and runbooks for efficiency and uptime.

Qualifications

• Bachelor's degree or equivalent hands-on experience in computer science, engineering, or related field.
• 3–6 years of experience supporting Linux servers, HPC, cloud, or data center infrastructure in production.
• Experience with enterprise compute hardware, BMC interfaces, OS, and monitoring tools.
• Familiarity with storage technologies (NFS, distributed filesystems, object storage).
• Experience with Bash or Python scripting for diagnostics and automation.
• Exposure to NVIDIA GPU systems, InfiniBand/RDMA, Kubernetes, Slurm, or AI/HPC storage is a plus.

Responsibilities

• Own and manage Tier 2 incidents, service requests, and tickets from triage to resolution.
• Diagnose compute and storage faults using logs, dashboards, and tools.
• Coordinate with NOC and site teams to restore service within SLA targets.
• Troubleshoot Linux servers, GPU health, firmware/driver issues, and hardware faults.
• Assist with provisioning, reimaging, config changes, and maintenance.
• Investigate Kubernetes/Slurm node or workload failures with Tier 3 engineers as needed.
• Perform first-level analysis of connectivity or GPU communication issues.

Skills

Linux servers

HPC

Kubernetes

Slurm

NVIDIA GPUs

Python

Education

Bachelor's degree in computer science, engineering, or related discipline

Tools

iDRAC/iLO

Monitoring tools

Job description

Highrise AI is seeking a mid-level AI Infrastructure Operations Engineer to provide Tier 2 support for large-scale GPU compute and storage platforms. You will own technical tickets, diagnose issues, and ensure reliable day-to-day operation across production clusters.

Work with NOC, on-site technicians, SRE teams, and Tier 3 engineers to resolve problems, while contributing to automation and runbooks for efficiency and uptime.