Staff RL Infrastructure Engineer for LLM Inference

xAI

Palo Alto (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

xAI in Palo Alto is seeking an experienced RL infrastructure engineer to design and optimize the inference stack for varied RL workloads, from research experiments to production runs. You will collaborate with modelling and data teams and own performance profiling and optimization across the stack.

We value deep technical curiosity, hands-on coding in Python/C++/Rust, and practical experience with LLM inference frameworks like PyTorch, Jax, and CUDA.

Qualifications

  • Experience in building, debugging, and optimizing efficiency of large-scale distributed systems.
  • Experience in LLM inference.
  • Proficiency in programming languages such as Python, C++ and/or Rust; frameworks such as PyTorch, Jax, CUDA.

Responsibilities

  • Design and optimize our inference stack for all shapes of RL workloads at xAI, from small scale ablations to production training runs.
  • Analyze, profile and address performance bottlenecks in large scale RL systems
  • Work closely with the modelling team to efficiently implement novel RL techniques and algorithms

Skills

Distributed systems
LLM inference
Python
C++
Rust
PyTorch
Jax
CUDA

Tools

SGLang
vLLM

Job description

xAI in Palo Alto is seeking an experienced RL infrastructure engineer to design and optimize the inference stack for varied RL workloads, from research experiments to production runs. You will collaborate with modelling and data teams and own performance profiling and optimization across the stack.

We value deep technical curiosity, hands-on coding in Python/C++/Rust, and practical experience with LLM inference frameworks like PyTorch, Jax, and CUDA.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff - RL Inference
Member of Technical Staff - RL Inference

xAI • Palo Alto (CA)

On-site
USD 180,000 - 260,000
Staff RL Inference Engineer - Large-Scale Systems
Staff RL Inference Engineer - Large-Scale Systems

SpaceXAI • Palo Alto (CA)

On-site
USD 180,000 - 440,000
RL Inference Engineer: Low-Precision ML at Scale
RL Inference Engineer: Low-Precision ML at Scale

SpaceX Super Intelligence • Palo Alto (CA)

On-site
USD 180,000 - 440,000
Equity
Health insurance
401(k) retirement plan
+2
AI Infrastructure Engineer
AI Infrastructure Engineer

Pokee AI • United States

Remote
USD 140,000 - 220,000
Research Engineer - GPU Inference for RL Systems (Remote)
Research Engineer - GPU Inference for RL Systems (Remote)

Prime Intellect AI • San Francisco (CA)

Hybrid
USD 150,000 - 350,000
Cash compensation
Remote option
Visa sponsorship
+2
Software Engineer, Inference Runtime
Software Engineer, Inference Runtime

LM Studio • New York (NY)

On-site
USD 140,000 - 210,000
Competitive salary and equity grants
Catered team lunch / expensed dinners
Senior RL Inference Engineer — Large-Scale ML, Equity
Senior RL Inference Engineer — Large-Scale ML, Equity

Maven Ventures • Palo Alto (CA)

On-site
USD 180,000 - 440,000
Equity
Medical coverage
Vision coverage
+4
Senior AI & LLM Systems Engineer
Senior AI & LLM Systems Engineer

Syscov • United States

Remote
USD 140,000 - 220,000
Research Engineer - RL Infrastructure & Agentic AI
Research Engineer - RL Infrastructure & Agentic AI

Storm3 • San Francisco (CA)

On-site
USD 150,000 - 210,000
Medical Insurance
Dental Insurance
Vision Insurance
Member of Technical Staff, Inference
Member of Technical Staff, Inference

Inferact • San Francisco (CA)

Hybrid
USD 200,000 - 400,000
Health, dental, and vision benefits
401(k) company match
Visa sponsorship on case-by-case basis