RL Systems Engineer - Scale & Post-Training

Luma

Redwood City (CA)

On-site

USD 200,000 - 300,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Luma is hiring to build and scale reinforcement learning systems that power large-scale models. You will run post-training RL pipelines across thousands of GPUs, crafting environments, reward signals, and verifiers while integrating inference engines like vLLM and SGLang.

You’ll advance throughput, stability, and efficiency, collaborating with researchers to turn ideas into production training and evaluation runs in a fast, scalable, multi-GPU setting.

Qualifications

  • Hands-on experience post-training LLMs with RL (PPO/GRPO-family, RLHF, RLVR) at meaningful scale.
  • Extensive distributed PyTorch training and parallelism (FSDP, Tensor/Pipeline/Expert Parallel) for foundation models.
  • Experience building RL environments, reward functions, verifiers, or evaluation harnesses for LLM agents, including sandboxed execution and multi-turn tool use.
  • Deep familiarity with RL post-training frameworks (veRL, OpenRLHF, TRL, Ray orchestration) and rollout inference engines (vLLM, SGLang).
  • Strong understanding of GPU clusters, networking, and communication libraries (NCCL, MPI) under mixed training and inference workloads.

Responsibilities

  • Design, build, and scale distributed RL post-training systems, orchestrating trainer, rollout, environment, and reward workloads across thousands of GPUs.
  • Build high-throughput rollout generation, integrating inference engines (vLLM, SGLang), weight synchronization, and asynchronous/off-policy schemes.
  • Design RL environments for agentic, multi-step tasks — sandboxed code execution, tool use, computer use, multimodal interaction — reproducible and scalable to millions of episodes.
  • Build reward infrastructure: verifiable/programmatic rewards, reward-model serving, LLM-as-judge pipelines, and defenses against reward hacking.
  • Develop the evaluation, monitoring, and debugging tooling that keeps large RL runs stable.
  • Advance training efficiency and stability, and turn new post-training ideas into production runs with researchers.

Skills

RL at scale
Distributed PyTorch
GPU clusters
RL frameworks
Rollout inference

Tools

vLLM
SGLang
NCCL
MPI
Ray
Kubernetes

Job description

Luma is hiring to build and scale reinforcement learning systems that power large-scale models. You will run post-training RL pipelines across thousands of GPUs, crafting environments, reward signals, and verifiers while integrating inference engines like vLLM and SGLang.

You’ll advance throughput, stability, and efficiency, collaborating with researchers to turn ideas into production training and evaluation runs in a fast, scalable, multi-GPU setting.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Distributed RL Systems Engineer — Scale Training & Inference
Distributed RL Systems Engineer — Scale Training & Inference

Luma AI • United States

Remote
USD 180,000 - 240,000
Research Scientist / Engineer – Reinforcement Learning Infrastructure
Research Scientist / Engineer – Reinforcement Learning Infrastructure

Luma • Redwood City (CA)

On-site
USD 200,000 - 300,000
RL Systems Engineer: Scale Training Pipelines & GPUs
RL Systems Engineer: Scale Training Pipelines & GPUs

Jobtailor • Palo Alto (CA)

On-site
USD 150,000 - 210,000
RL Post-Training Systems Engineer (Distributed Infra)
RL Post-Training Systems Engineer (Distributed Infra)

NVIDIA • New York (NY)

On-site
USD 184,000 - 357,000
Tech Lead Manager- MLRE, ML Systems
Tech Lead Manager- MLRE, ML Systems

Scale AI • San Francisco (CA)

On-site
USD 120,000 - 160,000
RL Infrastructure Engineer — Scale & Production
RL Infrastructure Engineer — Scale & Production

Inception • San Francisco (CA)

On-site
USD 200,000 - 350,000
Health, dental, and vision insurance
Catered meals (breakfast, lunch, &
Equity
+1
RL Systems Engineer: Inference & Training at Scale
RL Systems Engineer: Inference & Training at Scale

xAI • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Member of Technical Staff, RL Infra
Member of Technical Staff, RL Infra

Inception • San Francisco (CA)

On-site
USD 180,000 - 240,000
ML Systems Engineer - Scalable Training & Inference
ML Systems Engineer - Scalable Training & Inference

Scale AI, Inc. • New York (NY)

On-site
USD 189,000 - 237,000
Equity
Benefits
Commuter stipend
Senior RL Post-Training Systems Engineer
Senior RL Post-Training Systems Engineer

NVIDIA • Massachusetts

On-site
USD 224,000 - 357,000