Operations Engineer, 24/7 GPU & Data Hall Ops

Maven Ventures; Southaven (MS); Presencial; USD 120.000 - 190.000; Jornada completa

Descripción de la vacante

SpaceXSI is building Super Intelligence to help humanity understand the universe. SpaceXSI Operations Engineer, SuperCompute, owns 24/7 GPU uptime across compute and facility and leads incident response for data halls.

You will build automation, SOPs, and cross-functional processes to scale reliability of AI/ML infrastructure. You will collaborate with technicians and engineers to deploy new data halls, improve monitoring, and drive proactive incident response across geographies.

Formación

• Bachelor's degree in mechanical, electrical, or computer engineering, or a scientific discipline and 2+ years of experience in data center, critical facilities, power plant, or large-scale compute operations; OR 6+ years of professional experience in those environments in lieu of a degree

Responsabilidades

• Own monitoring architecture, alerting, signal quality, and automation of monitoring across GPU and host telemetry (DCGM, Prometheus/Grafana) and facility telemetry (BMS, EPMS, DCIM, SCADA, CDU / direct liquid cooling)
• Own compute hardware change incorporation - physical, firmware, software
• Be part of 24/7 incident response, mitigation, and control authority - end to end - from customer impact back to the facility
• Own day-to-day site sustainment operations, including resolving issues impacting rack-level compute and facility infrastructure
• Disposition daily issues across both site operations (rack compute) and facility operations (power and cooling)
• Lead acceptance and deployment testing campaigns to bring new data halls fully online
• Develop production automation for new data hall bring-up, automation behind alerting and automated incident response
• Develop and maintain standard operating procedures and planning for facility and site technicians, including change / upgrade incorporation planning on both rack level and facility
• Own and document the live, changing state of data hall operation as new halls come online
• Enable Site Operations and Facility Operations technicians to do their day to day jobs more efficiently and safely to increase GPU uptime
• Create predictive and responsive automation to alerts and incidents to enable your response to be faster and more impactful
• Lead cross-functional reliability projects spanning compute, network (InfiniBand/RoCE), storage, and facility signal boundaries, including grey failures that cross those boundaries (e.g., NVLink flapping, thermal throttling, power sequencing)
• Truly root cause systemic and design failure classes across hardware and integrated facility and operations systems: turn fleet data (MTBF/AFR, repeat-RMA trends) into proactive alerting, standard responses, vendor RCA inputs, and supplier corrective actions

Conocimientos

Prometheus/Grafana

NVIDIA DCGM

Industrial telemetry

Incident command

Python scripting

C/C++/Go/Rust

Cross-functional teams

GPU/AI hardware

Automation playbooks

Educación

Bachelor's degree in engineering or scientific discipline with 2+ years data center/compute ops; or 6+ years in lieu

Herramientas

Redfish/IPMI

BMS/EPMS/DCIM

SCADA

Descripción del empleo

SpaceXSI is building Super Intelligence to help humanity understand the universe. SpaceXSI Operations Engineer, SuperCompute, owns 24/7 GPU uptime across compute and facility and leads incident response for data halls.

You will build automation, SOPs, and cross-functional processes to scale reliability of AI/ML infrastructure. You will collaborate with technicians and engineers to deploy new data halls, improve monitoring, and drive proactive incident response across geographies.