AI Infrastructure SRE - GPU Clusters

Spacex; Redmond (WA); Hybrid; USD 125,000 - 200,000; Full time

Benefits offered by this job

Stock options

401(k) plan

Comprehensive medical benefits

Paid vacation and holidays

Job summary

SpaceX is seeking a Site Reliability Engineer for AI Infrastructure (Starshield) in Redmond, WA. The role focuses on designing, operating, and scaling GPU-backed AI infrastructure and on-premise Kubernetes clusters to support national security missions.

You will collaborate with AI engineers, develop automation, and ensure high availability across systems while navigating sensitive security requirements.

Qualifications

• Bachelor’s degree in computer science, information systems/IT, or an engineering discipline and 1+ years of professional SRE/DevOps experience or 3+ years without a degree.
• 1+ years of professional Linux experience.
• Experience with infrastructure tools such as Terraform, Ansible, or similar.
• Experience with containerization and Kubernetes.
• Scripting experience with Bash, Python, or similar.
• Development experience in Python, C++, or Go.

Responsibilities

• Manage GPU service for external customers on bare metal and virtualized platforms.
• Design and productize AI cluster solutions at large scale (100k+ GPUs).
• Develop automation to deploy and manage on-premise KubernetesAI clusters and OSes.
• Deploy and manage core infrastructure including databases, monitoring, and storage.
• Collaborate with AI engineers to build scalable, operable products.
• Oversee full lifecycle of services from design to operation and refinement.
• Support monitoring and alerting to ensure high availability.
• Identify improvement areas and implement innovative solutions for reliability.

Skills

Linux

Bash

Python

C++

Go

DevOps

Kubernetes

Networking

Cloud computing

Education

Bachelor's degree in CS/IT/Engineering

Tools

Terraform

Ansible

Docker

Kubernetes

Job description

Site Reliability Engineer, AI Infrastructure (Starshield)

Redmond, WA

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today SpaceX is actively developing the technologies to make this possible, with the ultimate goal ofenabling human life on Mars.

SITE RELIABILITY ENGINEER (STARSHIELD)

At SpaceX we’re leveraging our experience in building rockets and spacecraft to deploy the Starshield constellation. Starshield is the world’s largest US government satellite constellation and is tasked with providing immediate access to critical intelligence and national security data for the US government anywhere on the globe. We design, build, test, and operate all parts of the system – receivers that allow users to connect within minutes, and the software that brings it all together. We’ve only begun to scratch the surface of Starshield's global impact and are looking for best-in-class engineers to help us further our ambitious goals.

As an engineer focused on Starshield's software and GPU infrastructure, you will design, operate and scale the infrastructure that supports critical national security missions. These positions cover a variety of areas ranging from Site Reliability Engineering, Developer Operations, and GPU platforms. You will develop automation to deploy and manage on-premise compute resources, create highly scalable and maintainable software products, and directly collaborate with engineering across the board.

RESPONSIBILITIES:

• Manage and provide support for GPU as a service for external customers on bare metal hardware and virtualized platforms
• Design, validate, and productize solutions for AI clusters (100k+ GPU scale)
• Develop automation to deploy and manage on-premise Kubernetes\AI clusters, and operating systems
• Deploy and manage core infrastructure such as databases, monitoring and distributed storage
• Closely collaborate with AI engineers to create highly scalable, operable, and maintainable products
• Engage in and improve the whole lifecycle of services -- from inception and design, through deployment, operation and refinement
• Monitoring and alerting supporting systems to have high availability
• Identify areas for improvement and create innovative solutions that enable high system availability

BASIC QUALIFICATIONS:

• Bachelor’s degree in computer science, information systems/IT, or an engineering discipline and 1+ years of professional experience in site reliability engineering or DevOps; OR 3+ years of professional experience in site reliability engineering or DevOps in lieu of a degree
• 1+ years of professional experience with Linux operating systems
• Experience with Terraform, Ansible, or other infrastructure tools
• Experience with containerization technologies (i.e. OCI containers, Kubernetes)
• Experience scripting in Bash, Python, or other similar languages
• Development experience in Python, C++, or Go

PREFERRED SKILLS AND EXPERIENCE:

• 1+ years of experience with Python and Python-based development frameworks
• Experience managing Kubernetes clusters, not just using them
• Knowledge of Linux boot process and systems configuration
• Deep understanding of testing, continuous integration, build, deployment & continuous monitoring
• Understanding of relevant build technologies, such as Bazel and Makefiles
• Focus on performance bottlenecks and performance improvement techniques
• Understanding of distributed databases and data modeling
• Experience with automatically managing thousands of servers (eg: Terraform or Ansible)
• Strong networking knowledge of TCP/IP
• Cloud virtualization experience (as the cloud provider)
• Excellent communications skills with the ability to communicate with customers, peers, management etc. in both formal and informal situations
• Active Top Secret, Top Secret SCI, or DOE Level Q clearance

ADDITIONAL REQUIREMENTS:

• Must be willing to work extended hours and weekends as needed
• Must be willing to travel domestically and globally in the future when needed
• This position requires successfully obtaining and maintaining a Top Secret Security Clearance as a condition of employment. While the clearance may not be immediately necessary upon hire, we encourage you to initiate the application process promptly upon accepting this offer. Your ability to secure the necessary clearance is essential for fulfilling key responsibilities of the role. Should you be unable to obtain it, SpaceX reserves the right to modify or terminate your employment to align with operational needs.

COMPENSATION AND BENEFITS:

Pay Range:
Level 1: $125,000.00 - $165,000.00
Level 2: $145,000.00 - $200,000.00

Your actual level and base salary will be determined on a case-by-case basis and may vary based on the following considerations: job-related knowledge and skills, education, and experience.

Base salary is just one part of your total rewards package at SpaceX. You may also be eligible for long-term incentives, in the form of company stock or long-term cash awards, as well as potential discretionary bonuses and the ability to purchase additional stock at a discount through an Employee Stock Purchase Plan. You will also receive access to comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short and long-term disability insurance, life insurance, paid parental leave, and various other discounts and perks. You may also accrue 3 weeks of paid vacation and will be eligible for 10 or more paid holidays per year. Employees in Washington State accrue paid sick time in compliance with state and federal law. Company shuttles are offered to employees for roundtrip travel from select Seattle locations to the SpaceX Redmond office Monday to Friday.

Those with an active clearance will receive a 10% differential, up to an additional $20,000 annually, once officially briefed into a classified program.

• To conform to U.S. Government export regulations, applicant must be a (i) U.S. citizen or national, (ii) U.S. lawful, permanent resident (aka green card holder), (iii) Refugee under 8 U.S.C. § 1157, or (iv) Asylee under 8 U.S.C. § 1158, or be eligible to obtain the required authorizations from the U.S. Department of State. Learn more about the ITAR here .

SpaceX is an Equal Opportunity Employer; employment with SpaceX is governed on the basis of merit, competence and qualifications and will not be influenced in any manner by race, color, religion, gender, national origin/ethnicity, veteran status, disability status, age, sexual orientation, gender identity, marital status, mental or physical disability or any other legally protected status.

Applicants wishing to view a copy of SpaceX’s Affirmative Action Plan for veterans and individuals with disabilities, or applicants requiring reasonable accommodation to the application/interview process should reach out to [e-mail] .

Create a Job Alert

Interested in building your career at SpaceX? Get future opportunities sent straight to your email.

Accepted file types: pdf, doc, docx, txt, rtf

Education

School * Select...

Degree * Select...

Select...

LinkedIn Profile

Accepted file types: pdf, doc, docx, txt, rtf

Attach additional content you'd like us to review with your application. Please combine multiple attachments into a single .zip file.

How did you hear about this job? * Select...

If event or other, please specify below.

Please specify

GPA (Undergraduate) * Select...

Please convert your GPA to a 4.0 scale. Select "Not applicable/Do not recall" if you do not have or do not remember your undergraduate GPA.

GPA (Graduate) * Select...

Please convert your GPA to a 4.0 scale. Select "Not applicable/Do not recall" if you do not have or do not remember your graduate GPA.

GPA (Doctorate) * Select...

Please convert your GPA to a 4.0 scale. Select "Not applicable/Do not recall" if you do not have or do not remember your doctorate GPA.

SAT Score * Select...

Please indicate your test score on the 1600 or 2400 scale. Select "Did not take" if you have not taken the SAT.

ACT Score * Select...

Select "Did not take" if you have not taken the ACT.

GRE Score * Select...

Active Security Clearance(s) * Select...

SpaceX & SpaceXAI Employment History * Select...

This includes internships and full-time employment.

Can you perform all of the essential functions of this role with or without reasonable accommodations? * Select...

Are you legally authorized to work in the United States? * Select...

Select...

To conform to U.S. Government space technology export regulations, including the International Traffic in Arms Regulations (ITAR) you must be a U.S. citizen, lawful permanent resident of the U.S., protected individual as defined by 8 U.S.C. 1324b(a)(3), or eligible to obtain the required authorizations from the U.S. Department of State. Learn more about ITARhere.

If (f) Other, please explain:

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in SpaceX’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.