Site Reliability Engineer

SpaceXAI; Southaven (MS); On-site; USD 120,000 - 170,000; Full time

Job summary

SpaceXAI is seeking a Site Reliability Engineer focused on campus reliability in the Memphis/Southaven data center campus. You will design monitoring, lead incident command, and drive cross-discipline reliability work across compute, network, storage, power, and cooling.

You will own runbooks, run game days, define error budgets, and guide blameless postmortems with a strong emphasis on data-driven decisions and cross-functional collaboration with NOC, data center operations, and infrastructure

Qualifications

• Bachelor’s degree in Systems Engineering, CS, Electrical Engineering, or related field (or equivalent experience).
• 5+ years in site reliability, systems engineering, or large-scale production ops, HPC or data centers.
• Proven large-scale incident command experience and calm technical leadership on a bridge.
• Demonstrated monitoring and observability design at fleet or campus scale, including alert hygiene.
• Experience across at least two: compute, network, storage, power, and cooling / facilities telemetry.
• Experience writing and operating playbooks or runbooks with 24/7 operations or NOC.
• Proficiency in scripting (Python, Bash) for automation and analysis, plus at least one systems language (C, C++, Java, Go, Rust).
• Excellent problem-solving with a data-driven reliability mindset.
• Ability to work with cross-functional teams, including NOC, data center ops, and infra engineering.

Responsibilities

• Own monitoring architecture and signal quality; manage alerts and noise.
• Provide SEV command support: incident leadership, bridge with NOC, and timeline hygiene.
• Run blameless postmortems and drive corrective actions to closure.
• Lead cross-functional reliability projects spanning compute, network, storage, and facility signal boundaries.
• Build and maintain runbooks, run game days, and update dependency maps with NOC.
• Define error budgets and availability objectives at campus and service boundaries.
• Participate in on-call rotations and incident response for SEV-class events in the Memphis / Southaven campus.

Skills

Python

Bash

Go

Rust

C

C++

Java

Education

Bachelor's degree in Systems Engineering / CS / EE or related field

Job description

SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

ABOUT THE ROLE:

As a Site Reliability Engineer focused on campus reliability, you will design what the campus watches and trusts, technically command cross-discipline SEVs, and build the guardrails that make the next incident smaller. You are the connective tissue across compute, network, storage, power, and cooling. This role demands calm incident leadership, fleet-scale observability judgment, and the ability to drive reliability work across software and facility boundaries.

RESPONSIBILITIES:

• Own monitoring architecture and signal quality: what we alert on, suppress, and trust. Consume NOC noise-disposition feedback to drive suppression and redesign. Treat alert noise as a design failure, not an operator failure.
• Provide SEV command support: technical incident leadership, bridge coordination with the NOC, and timeline and severity hygiene.
• Run blameless postmortems and drive corrective actions to closed, not filed.
• Lead cross-functional reliability projects spanning compute, network, storage, and facility signal boundaries.
• Build and maintain playbooks, run game days, and keep cross-discipline dependency maps current. Own runbook quality jointly with the NOC (SRE designs; NOC operates and corrects).
• Define error budgets and availability objectives at campus and service boundaries as adopted by the business.
• Participate in on-call rotations and incident response for SEV-class events in the Memphis / Southaven data center campus.

BASIC QUALIFICATIONS:

• Bachelor’s degree in Systems Engineering, Computer Science, Electrical Engineering, or a related field (or equivalent experience).
• 5+ years of experience in site reliability, systems engineering, or large-scale production operations, preferably in high-performance computing or data center environments.
• Proven large-scale incident command experience and calm technical leadership on a bridge.
• Demonstrated monitoring and observability design at fleet or campus scale, including alert hygiene, suppression, and signal quality.
• Experience working across at least two of: compute, network, storage, power, and cooling / facilities telemetry.
• Experience writing and operating playbooks or runbooks with a 24/7 operations or NOC partner.
• Proficiency in scripting (Python, Bash) for automation and analysis, plus general experience in at least one systems language (C, C++, Java, Go, Rust, or similar). Not required to be expert in all of them.
• Excellent problem-solving skills with a data-driven approach to reliability engineering.
• Ability to work collaboratively with cross-functional teams, including NOC, data center operations, and infrastructure engineering.

PREFERRED SKILLS AND EXPERIENCE:

• Experience in AI/ML infrastructure or supercomputing environments.
• Hands-on definition and use of SLOs, SLIs, and error budgets at service or campus boundaries.
• Experience running game days, dependency mapping, and closed-loop corrective action programs.
• Familiarity with data center hardware and plant signals (servers, GPUs, networking, power, cooling) in addition to software telemetry.
• Prior work in a fast-paced startup or tech company like SpaceXAI.

SpaceXAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.