AI Sandbox & Infrastructure Engineer

Scale AI, Inc.; New York (NY); On-site; USD 180,000 - 225,000; Full time

Benefits offered by this job

Health, dental & vision coverage

Retirement benefits

Learning and development stipend

Generous PTO

Commuter stipend

Job summary

Scale AI, Inc. is seeking a Software Engineer for the AI Infrastructure team to build and evolve the agent sandboxing platform, a secure, high-performance code execution layer powering agentic workflows across internal and customer-managed environments.

You will pair deep systems expertise with a strong focus on developer experience, crafting clean APIs, thorough docs, and a polished client library while shaping roadmap and architecture with internal teams.

Qualifications

• 4+ years building high-performance systems software or libraries
• Experience with Linux process isolation, memory management, and cgroups/namespaces
• Experience with containerization/virtualization tech such as Docker, Firecracker, gVisor, QEMU or similar
• Proficiency in Go, Rust, or C/C++ for systems programming
• Obsessed with developer experience: API design, error messaging, and docs

Responsibilities

• Design and build the sandboxing platform, client library, and API surface for secure code execution across containerized and virtualized environments
• Ensure strong isolation, security, and reproducibility across user sessions and workloads
• Optimize for cold-start latency, memory footprint, and resource utilization at scale
• Reduce error rates through debugging, monitoring, and proactive fixes
• Collaborate with internal teams to understand needs and build tooling for use cases
• Respond to incidents with root-cause analysis and preventive fixes
• Help develop and maintain a product roadmap balancing immediate needs with long-term architecture
• Lead architecture reviews and manage end-to-end projects in cross-functional settings

Skills

High-performance systems

Linux internals

Containerization & virtualization

Go / Rust / C/C++

Developer experience & API design

Kubernetes understanding

Debugging & performance tuning

Tools

Docker

Firecracker

gVisor

QEMU

Kata Containers

Kubernetes

Job description

Scale AI, Inc. is seeking a Software Engineer for the AI Infrastructure team to build and evolve the agent sandboxing platform, a secure, high-performance code execution layer powering agentic workflows across internal and customer-managed environments.

You will pair deep systems expertise with a strong focus on developer experience, crafting clean APIs, thorough docs, and a polished client library while shaping roadmap and architecture with internal teams.