Staff RL Environments Engineer: End-to-End Systems

United States Digital Space LLC; San Francisco, New York (CA, NY); On-site; USD 252,000 - 315,000; Full time

Benefits offered by this job

Health insurance

Dental & vision coverage

:Learning stipend

Job summary

Scale AI is seeking a Staff Software Engineer, RL Environments, to own the technical foundation for scalable RL environments. You will design sandboxed execution, packaging, rollout orchestration, and verifier frameworks, while instrumenting environments with real applications and building capability-specific task suites.

This hands-on role requires strong Python, containerization skills, and experience with LLMs and large-scale backend systems.

Qualifications

• 8+ years of software engineering experience in distributed systems, design, data structures and algorithms.
• Strong Python skills with production software shipping experience; familiarity with at least one other stack (TypeScript/React, Go, Rust).
• Deep experience with containerization and sandboxed execution (Docker, VMs, gVisor/Firecracker, Kubernetes).
• Experience building/operating high-throughput backend systems: orchestration, scheduling, queues, data pipelines.
• Hands‑on experience building with LLMs including agent loops, tool calling, eval harnesses.
• Ability to own ambiguous problems end to end and ship a system.
• Excellent written and verbal communication; align engineers, researchers and non-engineering partners.

Responsibilities

• Own the technical foundation for RL environments at Scale.
• Design platform components: sandboxed execution, packaging, rollout, verifier frameworks, and authoring surfaces.
• Instrument environments by integrating real applications and building capability-specific task suites.
• Set technical direction across multiple teams and contribute the hard parts of the system.

Skills

Distributed systems

Python

TypeScript/React

Docker

Kubernetes

LLMs

Eval harnesses

System design

Communication

Tools

Docker

VMs

gVisor/Firecracker

Kubernetes

Job description

Scale AI is seeking a Staff Software Engineer, RL Environments, to own the technical foundation for scalable RL environments. You will design sandboxed execution, packaging, rollout orchestration, and verifier frameworks, while instrumenting environments with real applications and building capability-specific task suites.

This hands-on role requires strong Python, containerization skills, and experience with LLMs and large-scale backend systems.