Campus Reliability Engineer — Fleet-Scale SRE Lead

xAI; Southaven, Memphis (MS, TN); On-site; USD 120,000 - 190,000; Full time

Job summary

SpaceX is seeking a Site Reliability Engineer focused on campus reliability to design, monitor, and guard the reliability of one of the world’s largest AI training campuses. You will lead technical incident responses, coordinate cross-disciplinary teams, and ensure tight observability across compute, network, storage, and facility systems.

You will drive blameless postmortems, guide fleet-scale change management, and partner with NOC and hardware teams to reduce incident sizes and improve MTTR

Qualifications

• Bachelor's degree or equivalent experience in a relevant field.
• 5+ years of site reliability, systems engineering, plant operations, or large-scale production ops.
• Proven large-scale incident command experience and calm leadership.
• Monitoring/observability design at fleet or campus scale, alert hygiene and signal quality.
• Experience with at least Prometheus/Grafana, NVIDIA DCGM, or industrial telemetry/controls.

Responsibilities

• Own monitoring architecture and signal quality across GPU and host telemetry and facility telemetry.
• Drive suppression and redesign using NOC noise-disposition feedback.
• Treat alert noise as a design failure, not an operator failure.
• Provide SEV command support and incident leadership.
• Run blameless postmortems and drive corrective actions to closure.
• Gate high-risk changes (firmware/BIOS/BMC) with disciplined change management.
• Lead cross-functional reliability projects across compute, network, storage, and facility signals.
• Partner with Hardware Failure Analysis to convert fleet data into monitoring and RCA inputs.
• Build and maintain playbooks, run game days, and maintain dependency maps.

Skills

Incident leadership

Cross-functional collaboration

Data-driven decision making

SRE best practices

Blameless postmortems

Automation with scripting

Education

Bachelor's degree in Systems Engineering, CS, or EE

Tools

Prometheus/Grafana

NVIDIA DCGM

SCADA

BMS/BAS

EPMS

DCIM

PLC/Modbus/BACnet

Job description

SpaceX is seeking a Site Reliability Engineer focused on campus reliability to design, monitor, and guard the reliability of one of the world’s largest AI training campuses. You will lead technical incident responses, coordinate cross-disciplinary teams, and ensure tight observability across compute, network, storage, and facility systems.

You will drive blameless postmortems, guide fleet-scale change management, and partner with NOC and hardware teams to reduce incident sizes and improve MTTR