Staff Engineer, AI Infrastructure & Developer Tools

RadixArk; Palo Alto (CA); On-site; USD 200,000 - 400,000; Full time

Job summary

RadixArk is seeking experienced product-focused engineers to build developer-facing surfaces of our inference and training infrastructure. You will own end-to-end experiences across APIs, SDKs, dashboards, playgrounds, and tooling on top of SGLang, Miles, and the broader stack.

You’ll bridge GPU scheduling, model serving, and distributed training with high-level product surfaces, write performant code, and mentor peers while collaborating with Product Managers, researchers, and engineers.

Qualifications

• Bachelor’s degree in CS/CE or equivalent practical experience.
• 5+ years building production systems; 3+ years with a PhD in a relevant field.
• Strong coding skills in Python, TS/JS, Go, C++, or Rust.
• Experience shipping developer-facing APIs, SDKs, or tools.
• Ability to use data/analysis to drive decisions and improve design.

Responsibilities

• Collaborate with Product, Design, Research, and Infrastructure to ship developer-facing products.
• Build and maintain APIs, SDKs, CLIs, dashboards, and playgrounds atop RadixArk platforms.
• Develop high-performance UIs and developer experiences with scalable APIs.
• Architect scalable systems connecting low-level infra with high-level product surfaces.
• Lead design reviews and mentor peers on technical implementation and quality.

Skills

Python

TypeScript/JavaScript

Go

C++

Rust

API design

Developer tooling

Education

Bachelor's degree in CS/CE or equivalent

Tools

SGLang

Megatron

DeepSpeed

PyTorch

Ray

Job description

RadixArk is seeking experienced product-focused engineers to build developer-facing surfaces of our inference and training infrastructure. You will own end-to-end experiences across APIs, SDKs, dashboards, playgrounds, and tooling on top of SGLang, Miles, and the broader stack.

You’ll bridge GPU scheduling, model serving, and distributed training with high-level product surfaces, write performant code, and mentor peers while collaborating with Product Managers, researchers, and engineers.