AI Infra Resident (1-Year Program)

RadixArk; Palo Alto (CA); On-site; USD 70,000 - 90,000; Full time

Benefits offered by this job

Health benefits

Potential for full-time position with equity

Job summary

A cutting-edge AI infrastructure company in Palo Alto is launching a full-time, paid, 1-year residency for aspiring AI infrastructure engineers. Candidates will rotate through various aspects of AI infrastructure work, including inference and training, and collaborate closely with senior engineers on meaningful projects. This program offers competitive compensation and the potential for permanent roles after completion. Ideal candidates are equipped with a relevant degree and a strong foundation in systems programming and ML systems.

Qualifications

• Strong foundations in systems programming, ML systems, or high-performance computing.
• Experience with Python and/or C++; exposure to CUDA, JAX, or distributed systems is a plus.
• Demonstrated ability to learn quickly and debug complex technical problems.
• Desire to grow into a world-class AI infrastructure engineer.

Responsibilities

• Join a residency focused on AI infrastructure.
• Rotate across inference, training, kernels, compilers, and cluster infrastructure.
• Work on LLM serving, diffusion inference, and RL training.
• Own meaningful projects under mentorship from senior engineers.
• Contribute to open-source projects and document learnings.

Skills

Systems programming

Machine Learning systems

High-performance computing

Python

C++

CUDA

JAX

Distributed systems

Debugging complex problems

Communication skills

Education

Bachelor's or Master's degree in Computer Science or Engineering

Job description

RadixArk is launching a full‑time, paid, 1‑year residency program for aspiring AI infrastructure engineers. You'll rotate across inference, training, kernels, compilers, and cluster infrastructure, working on real production systems alongside senior engineers. This is an opportunity to learn from the team behind SGLang and Miles while owning meaningful projects that impact thousands of developers.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or related field (recent graduates welcome)
• Strong foundations in systems programming, ML systems, or high‑performance computing
• Experience with Python and/or C++; exposure to CUDA, JAX, or distributed systems is a plus
• Demonstrated ability to learn quickly and debug complex technical problems
• Curiosity, grit, and willingness to dive deep into unfamiliar layers of the stack
• Desire to grow into a world‑class AI infrastructure engineer
• Strong communication skills and ability to work collaboratively

Responsibilities

• Join a full‑time, paid, 1‑year residency focused on AI infrastructure
• Rotate across inference, training, kernels, compilers, and cluster infrastructure
• Work on real production systems: LLM serving (SGLang), diffusion inference (Flux, Wan), RL training (Miles), schedulers, and performance tooling
• Learn to debug failures across the full stack: model → runtime → kernel → hardware
• Own meaningful projects with close mentorship from senior engineers
• Contribute to SGLang, Miles, and other open‑source projects
• Document learnings and create guides for the community
• Present technical deep‑dives and share knowledge with the team
• Participate in code reviews and learn engineering best practices

About RadixArk

RadixArk is an infrastructure‑first company built by engineers who've shipped production AI systems, created SGLang (20K+ GitHub stars, the fastest open LLM serving engine), and developed Miles (our large‑scale RL framework). We're on a mission to democratize frontier‑level AI infrastructure by building world‑class open systems for inference and training. Our team has optimized kernels serving billions of tokens daily, designed distributed training systems coordinating 10,000+ GPUs, and contributed to infrastructure that powers leading AI companies and research labs. We're backed by well‑known investors in the infrastructure field and partner with Google, AWS, and frontier AI labs. Join us in building infrastructure that gives real leverage back to the AI community.

Compensation

We offer competitive compensation for this 1‑year residency program, with health benefits and potential for conversion to a full‑time role. Compensation is determined by location and prior experience. Strong residents may receive offers to join RadixArk full‑time with equity after program completion.

RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.