Member of Technical Staff (Evaluation Infrastructure)

xAI; Palo Alto (CA); Presencial; USD 180 000 - 260 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health insurance

Life and AD&D insurance

Fertility benefits

Flexible vacation

Visa sponsorship

401(k) plan

Resumo da oferta

xAI in Palo Alto is seeking an infrastructure engineer for the RL evaluation stack. You will build scalable, reliable evaluation infra that runs at scale and interfaces with modeling and evaluation teams.

You will identify bottlenecks across inference, capacity fleet management, async eval orchestration, and develop internal tools to support training next‑generation models. Collaboration and performance tuning are key.

Qualificações

• Experience building, debugging, and optimizing large-scale distributed systems.
• Proficiency in LLM inference workflows and evaluation signal quality.
• Ability to develop interfaces for comparing models and evals.
• Experience with GPU compute management and dynamic resource optimization.

Responsabilidades

• Develop and maintain evaluation infrastructure at scale.
• Collaborate with modeling and evaluation teams on new evals and tooling.
• Identify performance bottlenecks across inference, orchestration, and fleet management.
• Build internal tooling to support training of next-generation models.

Conhecimentos

LLM inference

Distributed systems

GPU compute management

Workload scheduling

Dynamic resource optimization

Model eval interfaces

Descrição da oferta de emprego

• The RL infrastructure team is looking for an engineer to help develop our evaluation infrastructure


• Build highly reliable, efficient, and easy to use infrastructure that runs all our evaluations at scale


• Collaborate closely with modeling & evaluation teams on developing new evals, maintaining evaluation signal quality, and building internal tooling to support training our next-generation of models


• Identify and resolve performance bottlenecks in all layers of the eval infrastructure stack, including inference, capacity fleet management, asynchronous eval orchestration, and more

Benefits

• Health and wellness: Comprehensive health insurance including medical, dental, vision, and disability coverage


• Life and family: Life and AD&D insurance and fertility benefits to ensure our team’s well-being and peace of mind


• Flexible vacation: We work hard but avoid burn out. Take time off when you need it


• Visa sponsorship: We support international talent with visa sponsorship to join our team


• 401(k) plan: Retirement savings plan to secure your financial future

Willingness to dive deep and solve hard problems at all levels of the stackExperience in building, debugging, and optimizing efficiency of large-scale distributed systemsExperience in LLM inferenceExperience in developing interfaces for comparing models and evalsExperience in GPU compute management, workload scheduling, and dynamic resource optimization