ML Infrastructure Engineer

SpaceXSI

Palo Alto (CA)

On-site

USD 180,000 - 440,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Medical, vision, dental
401(k)
Disability insurance
Life insurance
Employee discounts

Job summary

SpaceXSI is seeking an ML Infrastructure Engineer to design, build, and optimize a high-performance ML platform powering recommendations. You will scale GPU compute, data pipelines, and experimentation tooling, collaborating with ML teams to productionize models and ensure reliable, scalable systems.

Ideal candidates have 2+ years in large-scale environments, strong Python (plus C++/Rust), and experience with ML frameworks like JAX or PyTorch.

Qualifications

  • Bachelor, Master, Post-graduate or PhD in computer science, ML, or quantitative discipline; or equivalent work experience
  • 2+ years in high-traffic or large-scale production environments, distributed systems, GPU infra, or DL apps
  • 2+ years experience with ML platforms, training infra, or collaboration with modeling/data science teams
  • Strong proficiency with Python and experience with C++ or Rust

Responsibilities

  • Design, build, and scale GPU compute infrastructure, training frameworks, and experimentation tools
  • Develop data pipelines and integrate large-scale data, training, and inference systems
  • Collaborate with ML teams to productionize models and ensure seamless integration
  • Ensure scalability, reliability, and efficiency of large-scale ML systems
  • Work across the full stack to solve complex problems independently
  • Mentor junior engineers and contribute to team growth

Skills

Python
C++
Rust
JAX
PyTorch
Linux

Education

Bachelor/Master/PhD in CS or related field

Tools

Slurm
Puppet/Ansible
NVIDIA drivers
CUDA toolkit

Job description

SpaceX was founded under the belief that a future where humanity is out exploring the stars is fundamentally more exciting than one where we are not. Today, SpaceX is actively developing the technologies to make this possible, with the ultimate goal of making life multiplanetary and expanding consciousness to the stars.
SpaceXSI is building Super Intelligence to help humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel where more compute trains better models, better models power more useful products, and what we learn from people using those products shapes what we build next.

ABOUT THE ROLE:

As an ML Infrastructure Engineer, you will play a pivotal role in building and optimizing the reliable, high-performance ML platform that powers recommendations on X. We're looking for exceptional engineers who are passionate about our mission and have a strong desire to make a meaningful impact.

RESPONSIBILITIES:
  • Designing, building, and scaling GPU compute infrastructure, training frameworks, and experimentation tools to enable rapid iteration on ML hypotheses
  • Developing data pipelines and integrating large-scale data, training, and inference systems
  • Collaborating with ML teams to productionize models and ensure seamless integration across the stack
  • Ensuring scalability, reliability, and efficiency of large-scale machine learning systems
  • Working across the full stack to solve complex problems independently
  • Mentoring junior engineers and contributing to the growth of the team
BASIC QUALIFICATIONS:
  • Bachelor, Master, Post-graduate or PhD in computer science, machine learning, or other quantitative discipline; or equivalent work experience
  • 2+ years of industry experience working with high traffic or large-scale production environments, distributed systems, GPU infrastructure, and/or deep learning applications
  • 2+ years experience with ML platforms, training infrastructure, or close collaboration with modeling engineers and data scientists
  • Strong proficiency with Python and experience with compiled languages such as C++ or Rust
PREFERRED SKILLS AND EXPERIENCE:
  • Deep familiarity with modern ML frameworks such as JAX or PyTorch
  • Low-level understanding of compute systems, including distributed storage, NVIDIA drivers, CUDA toolkits, and networking
  • Comfortable with Linux systems and orchestration tools
  • Experience with job schedulers (e.g., Slurm), configuration management (Puppet/Ansible), or related infrastructure tooling
COMPENSATION AND BENEFITS:

$180,000 - $440,000 USD

Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Infrastructure Engineer - Scalable GPU Platform + Equity
ML Infrastructure Engineer - Scalable GPU Platform + Equity

Maven Ventures • Palo Alto (CA)

On-site
USD 180,000 - 440,000
Equity
Comprehensive medical, vision, and/or
Dental coverage
+4
ML Infrastructure Engineer
ML Infrastructure Engineer

Maven Ventures • Palo Alto (CA)

On-site
USD 180,000 - 440,000
Equity
Comprehensive medical, vision, and/or
Dental coverage
+4
Software Engineer - Platform Infrastructure (Rust, C++)
Software Engineer - Platform Infrastructure (Rust, C++)

SpaceXSI • Palo Alto (CA)

On-site
USD 180,000 - 440,000
Equity
Medical insurance
Vision & Dental
+4
Software Engineer - X Data Engineering
Software Engineer - X Data Engineering

SpaceXSI • Palo Alto (CA)

On-site
USD 125,000 - 400,000
Analytics Engineer - X
Analytics Engineer - X

SpaceXSI • Palo Alto (CA)

On-site
USD 180,000 - 440,000
Equity
Medical insurance
401(k) retirement plan
+2
Member of Technical Staff - RL Inference
Member of Technical Staff - RL Inference

SpaceXSI • Palo Alto (CA)

On-site
USD 180,000 - 440,000
Member of Technical Staff - RL Inference Palo Alto, California
Member of Technical Staff - RL Inference Palo Alto, California

Maxxd • Palo Alto (CA)

Hybrid
USD 180,000 - 440,000
Equity
Medical, vision, dental
401(k) retirement plan
Exceptional Software Engineer
Exceptional Software Engineer

SpaceXSI • Palo Alto (CA)

On-site
USD 180,000 - 440,000
Comprehensive medical vision dental
401(k) retirement plan
Short & long-term disability insurance
+2
Software Engineer, Data Platform
Software Engineer, Data Platform

SpaceXSI • Palo Alto (CA)

On-site
USD 180,000 - 440,000
Equity
Medical, Vision & Dental
401(k)
+3
Member of Technical Staff - Post-Training and RL
Member of Technical Staff - Post-Training and RL

SpaceXSI • Palo Alto (CA)

On-site
USD 180,000 - 600,000
Equity
Medical
Vision
+5