Senior RL Infrastructure Engineer - Scalable GPU Systems

Vmax AI Corp; San Francisco (CA); Hybrid; USD 300,000 - 500,000; Full time

Benefits offered by this job

Hybrid work arrangement

Job summary

Vmax AI Corp is seeking a strong infrastructure engineer to build the systems layer for RL at scale. You will enable thousands of GPUs to run, debug, and reproduce large-scale RL experiments, tackling training orchestration, data pipelines, and observability.

You will own infra projects end to end—from architecture to deployment—while aligning with ML researchers to translate complex experiments into durable, scalable platforms within our San Francisco office (hybrid option possible).

Qualifications

• Strong software engineering experience.
• Experience building infrastructure for LLM inference and RL training.
• Experience with GPU clusters, distributed training, model serving, or high-throughput inference systems.
• Familiarity with vLLM, SGLang and modern LLM-RL training frameworks.
• Strong understanding of system reliability, observability, testing, debugging, and performance optimization.
• Ability to translate messy experimental workflows into durable infrastructure.
• Experience building tools, platforms, or services used by other technical users.

Responsibilities

• Build infrastructure for distributed RL training and inference across thousands of GPUs.
• Improve the reliability, debuggability, and throughput of RL experiments.
• Build interfaces that allow researchers and applied ML engineers to launch, inspect, compare, and reproduce experiments easily.
• Own infrastructure projects end to end, from architecture and implementation through deployment, documentation, and long-term maintenance.
• Identify and eliminate bottlenecks in training, rollout generation, eval execution, data movement, and cluster utilization.
• Maintain engineering standards for RL infrastructure, including testing, observability, versioning, and reproducibility.

Skills

Software engineering

LLM infra

GPUs & distributed training

vLLM

SGLang

Reliability & observability

Experiment-driven infra

Job description

Vmax AI Corp is seeking a strong infrastructure engineer to build the systems layer for RL at scale. You will enable thousands of GPUs to run, debug, and reproduce large-scale RL experiments, tackling training orchestration, data pipelines, and observability.

You will own infra projects end to end—from architecture to deployment—while aligning with ML researchers to translate complex experiments into durable, scalable platforms within our San Francisco office (hybrid option possible).