Staff Engineer - Scalable RL Eval Infra & LLM Inference

xAI; Palo Alto (CA); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Health insurance

Life and AD&D insurance

Fertility benefits

Flexible vacation

Visa sponsorship

401(k) plan

Job summary

xAI in Palo Alto is seeking an infrastructure engineer for the RL evaluation stack. You will build scalable, reliable evaluation infra that runs at scale and interfaces with modeling and evaluation teams.

You will identify bottlenecks across inference, capacity fleet management, async eval orchestration, and develop internal tools to support training next‑generation models. Collaboration and performance tuning are key.

Qualifications

• Experience building, debugging, and optimizing large-scale distributed systems.
• Proficiency in LLM inference workflows and evaluation signal quality.
• Ability to develop interfaces for comparing models and evals.
• Experience with GPU compute management and dynamic resource optimization.

Responsibilities

• Develop and maintain evaluation infrastructure at scale.
• Collaborate with modeling and evaluation teams on new evals and tooling.
• Identify performance bottlenecks across inference, orchestration, and fleet management.
• Build internal tooling to support training of next-generation models.

Skills

LLM inference

Distributed systems

GPU compute management

Workload scheduling

Dynamic resource optimization

Model eval interfaces

Job description

xAI in Palo Alto is seeking an infrastructure engineer for the RL evaluation stack. You will build scalable, reliable evaluation infra that runs at scale and interfaces with modeling and evaluation teams.

You will identify bottlenecks across inference, capacity fleet management, async eval orchestration, and develop internal tools to support training next‑generation models. Collaboration and performance tuning are key.