Member of Technical Staff, Infrastructure Lead (RL and Inference)

Kindredventures

Palo Alto (CA)

Presencial

USD 230.000 - 360.000

Tempo integral

Há 5 dias
Seja uma das primeiras pessoas a se candidatar

Uma candidatura completa em um minuto

Currículo e carta de apresentação personalizados, prontos para serem enviados.

Passe pelos filtros ATS

Resumo da vaga

Kindredventures is seeking an infrastructure lead to own the systems that train and serve our models in a fast-paced AI research environment. You will direct the RL training stack, scale GPU clusters, and own the inference platform that serves specialized models to customers.

You will shape the technical direction, code hands-on in early months, and build and mentor a growing team. You will work closely with research leads and report to the VP of Engineering, coordinating with cloud providers

Qualificações

  • 7+ years building ML or distributed systems infrastructure.
  • 2+ years leading an engineering team.
  • Led teams that built and ran large scale ML training or inference systems.
  • Deep experience with distributed systems and training large models across many GPUs.
  • Hands on with PyTorch and frameworks like FSDP, DeepSpeed, Megatron-LM, or Ray.
  • Production experience with LLM serving and inference engines such as vLLM, SGLang, or TensorRT-LLM.
  • Strong Python skills; C++ or CUDA is a plus.
  • Experience hiring and growing strong engineers.
  • Comfortable with ambiguity and owning large problems end to end.

Responsabilidades

  • Own the end to end RL training system: rollout generation, reward and verifier services, policy updates, and evaluation.
  • Own production inference: serving many fine tuned models on shared hardware, safe rollouts of new versions, and deployments in customer clouds and VPCs.
  • Keep long training runs healthy without manual intervention, and make researchers faster.
  • Improve throughput and GPU utilization across training and inference, and plan compute with the research team.
  • Integrate inference engines such as vLLM or SGLang into the training loop and optimize them for RL workloads.
  • Make the hard calls on architecture, vendors, and clouds, and explain them clearly to the team.
  • Hire, grow, and lead the infrastructure team as we scale.
  • Set engineering standards, on call practices, and the quality bar for the group.

Conhecimentos

ML infrastructure
Distributed systems
Team leadership
Python
C++/CUDA
Hiring engineers
RL workflows

Ferramentas

PyTorch
FSDP
DeepSpeed
Megatron-LM
Ray
vLLM
SGLang
TensorRT-LLM
Kubernetes
Slurm

Descrição da vaga

About Us

We are a small team of researchers and engineers focused on pushing the frontier of what agents are capable of. We believe the next leap in agent performance will come not from bigger general models, but from specialization and continual learning: agents that get better at their specific job the more they do it. We build the systems that make this possible, turning real-world usage into lasting improvement.


Summary

We are looking for an infrastructure lead to own the systems that train and serve our models. You will be responsible for our reinforcement learning stack, which runs rollouts and trains models across large GPU clusters for days at a time, and for the inference platform that serves many specialized models to customers. You will set the technical direction for both, build them hands on in the first months, and then hire and lead the team that runs them. You will work closely with our research leads and report to our VP of Engineering.


Responsibilities


  • Own the end to end RL training system: rollout generation, reward and verifier services, policy updates, and evaluation.

  • Own production inference: serving many fine tuned models on shared hardware, safe rollouts of new versions, and deployments in customer clouds and VPCs.

  • Keep long training runs healthy without manual intervention, and make researchers faster.

  • Improve throughput and GPU utilization across training and inference, and plan compute with the research team.

  • Integrate inference engines such as vLLM or SGLang into the training loop and optimize them for RL workloads.

  • Make the hard calls on architecture, vendors, and clouds, and explain them clearly to the team.

  • Hire, grow, and lead the infrastructure team as we scale.

  • Set engineering standards, on call practices, and the quality bar for the group.


Qualifications


  • 7+ years building ML or distributed systems infrastructure, including 2+ years leading an engineering team.

  • A track record of leading teams that built and ran large scale ML training or inference systems.

  • Deep experience with distributed systems and training large models across many GPUs.

  • Hands on experience with PyTorch and distributed training frameworks such as FSDP, DeepSpeed, Megatron-LM, or Ray.

  • Production experience with LLM serving, including inference engines such as vLLM, SGLang, or TensorRT-LLM.

  • Solid understanding of RL workflows for language models and agents.

  • Strong Python skills. C++ or CUDA is a plus.

  • Experience hiring and growing strong engineers.

  • Comfortable with ambiguity and able to own large problems end to end.


Nice to Have


  • Led RL, training, or inference infrastructure at a frontier lab or AI infrastructure company.

  • Contributions to open source RL, training, or inference frameworks.

  • Experience with Kubernetes, Slurm, or other cluster schedulers at scale.

  • Experience with agent environments, code execution sandboxes, or continual learning systems.

Obtenha sua revisão de currículo grátis e confidencial.

ou arraste e solte seu arquivo aqui.

Similar jobs

Vagas similares que valem a pena comparar

Member of Technical Staff, RL Infrastructure
Member of Technical Staff, RL Infrastructure

Kindredventures • Palo Alto (CA)

Presencial
USD 150.000 - 230.000
Member of Technical Staff, Inference Infrastructure
Member of Technical Staff, Inference Infrastructure

Kindredventures • Palo Alto (CA)

Presencial
USD 190.000 - 240.000
AI Infrastructure Engineer
AI Infrastructure Engineer

Pokee AI • EUA

Remoto
USD 140.000 - 220.000
Staff AI Product Engineer
Staff AI Product Engineer

nscaleoperationsukltd • Georgia

Presencial
USD 180.000 - 240.000
Member of Technical Staff, Post-Training
Member of Technical Staff, Post-Training

Kindredventures • Palo Alto (CA)

Presencial
USD 150.000 - 190.000
Research Scientist / Engineer – Reinforcement Learning Infrastructure
Research Scientist / Engineer – Reinforcement Learning Infrastructure

lumaai • EUA

Remoto
USD 180.000 - 260.000
Member of Technical Staff - ML Infrastructure Engineer, RL Post-training
Member of Technical Staff - ML Infrastructure Engineer, RL Post-training

Preference Model, Inc. • San Francisco (CA)

Presencial
USD 180.000 - 280.000
Competitive cash & equity ( >90th %ile
Ownership and autonomy
Work alongside senior staff from topML
+5
Machine Learning Engineer — Reinforcement Learning
Machine Learning Engineer — Reinforcement Learning

Institute of Foundation Models • Sunnyvale (CA)

Presencial
USD 150.000 - 450.000
Medical benefits
Dental benefits
Vision benefits
+7
Member of Technical Staff - ML Systems
Member of Technical Staff - ML Systems

NextToken AI Inc. • Mountain View (CA)

Presencial
USD 180.000 - 250.000
Research Engineer, ML Infrastructure
Research Engineer, ML Infrastructure

cognition • San Francisco (CA)

Presencial
USD 180.000 - 250.000