Member of Technical Staff — Developer Technology

RadixArk

Iowa

Vor Ort

USD 180.000 - 240.000

Vollzeit

14 Tage+

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Equity
Flexible work arrangements

Zusammenfassung

RadixArk is seeking a Member of Technical Staff to accelerate LLM inference and training on modern GPUs. You will profile, tune, and implement kernels and model support, with focus areas in inference performance or kernel enablement.

You’ll work closely with partners to translate complex problems into practical, production-ready solutions. You will collaborate across teams to push SGLang and Miles forward, delivering day-0 model support and scalable performance across NVIDIA and AMD platforms.

Qualifikationen

  • 4+ years in GPU systems, LLM infra, or perf engineering.
  • Strong profiling and debugging across the stack.
  • Hands-on GPU programming in CUDA, ROCm, or Triton.
  • Python and C++ or CUDA proficiency.
  • Ability to translate ambiguous problems into technical plans.

Aufgaben

  • Accelerate AI workloads by profiling and optimizing GPU performance for production workloads.
  • Specialize in one or two tracks: inference performance or kernels and model/hardware enablement.
  • Develop custom CUDA/ROCm/Triton kernels and day-0 model support.
  • Collaborate with ecosystem partners to turn hard problems into concrete wins.
  • Contribute improvements back into SGLang and Miles and roadmap.

Kenntnisse

GPU systems
Performance engineering
Profiling
Python
C++
Debugging
Cross-platform
Adaptability

Tools

CUDA
ROCm
Triton
Python
TensorRT-LLM
Megatron
SGLang
Miles

Jobbeschreibung

About the Role

RadixArk is seeking a Member of Technical Staff, Developer Technology (DevTech) to make LLM inference and training dramatically faster, cheaper, and more accessible on modern GPU hardware. Our systems sit at the center of how modern AI is served and trained: SGLang is a high-performance inference engine that serves trillions of tokens daily across leading AI companies and research labs, and Miles is our reinforcement-learning post-training framework for large-scale LLM and MoE models. Your work directly advances our mission to democratize AI: every improvement you ship lowers the cost and raises the ceiling of what developers everywhere can build.

As our technical face to a community of expert users and partners, you’ll push the performance of SGLang and Miles through the lens of real production workloads. You’ll profile and optimize GPU performance, enable new models and hardware, build kernels, deliver day-0 model support, and push the limits of inference and training. Working in close partnership with leading teams across the ecosystem, you’ll turn their hardest, most ambiguous problems into concrete wins and clear guidance, and feed those improvements back into our systems and future roadmap.

Key Responsibilities
  • Accelerate AI workloads**.** Profile and optimize GPU performance for real production workloads on current and next-generation hardware, root-causing bottlenecks from kernels to distributed multi-node systems.
  • Go deep in one or two focus areas. The team collectively covers the full stack; each engineer specializes in one or two tracks:
  • Inference performance: engine tuning, benchmarking, long-context and multi-turn optimization, parallelism strategy, production debugging
  • Kernels and model/hardware enablement: custom CUDA/ROCm/Triton kernels, low-precision quantization, day-0 support for new models on new silicon
  • Speculative decoding: draft-model training, acceptance-rate tuning, cross-platform kernel adaptation
  • Training systems: RL post-training with Miles, FP8 training, elasticity, long-rollout and long-context efficiency
  • Partner directly with the ecosystem. Turn ambiguous, high-stakes problems from expert engineers at our key partners into concrete wins, clear technical guidance, and reproducible cookbooks.
  • Enhance SGLang and Miles**.** Feed user-driven improvements back into our open-source systems and roadmap, so every win compounds across the ecosystem.
Qualifications

Minimum Requirements

  • 4+ years of experience in GPU systems, LLM infrastructure, or performance engineering.
  • Strong profiling and debugging skills: able to root-cause performance and correctness issues across the stack.
  • Hands-on GPU programming experience in at least one of CUDA, ROCm, or Triton, and willingness to work across platforms.
  • Strong programming skills in Python plus C++ or CUDA.
  • Comfortable making progress on hard, ambiguous problems with little context to start from, and fast to ramp into unfamiliar systems, codebases, and domains.

Ability to translate ambiguous asks into clear technical plans, verified cookbooks, and actionable recommendations, and to communicate credibly with expert engineering audiences.

Preferred (Bonus) Qualifications

  • Deep familiarity with LLM inference internals: distributed serving, parallelism, routing, KV-cache management, scheduling.
  • Experience with low-precision quantization and inference/training (FP8, INT8/INT4; NVFP4 or MXFP4 a strong plus).
  • Experience writing and optimizing custom GPU kernels.
  • Practical familiarity with speculative decoding methods such as Eagle, DFlash, or DSpark.
  • Working knowledge of large-scale distributed training: pre-training, SFT, RL post-training, elasticity, long-context workloads.
  • Experience optimizing across both NVIDIA and AMD platforms.
  • Hands-on experience with SGLang, Miles, vLLM, TensorRT-LLM, Megatron, or comparable frameworks; contributions to open-source AI/ML projects.
About RadixArk

RadixArk is an infrastructure-first company built by engineers who’ve shipped production AI systems, created SGLang (20K+ GitHub stars, the fastest open LLM serving engine), and developed Miles (our large-scale RL framework).We’re on a mission to democratize frontier-level AI infrastructure by building world-class open systems for inference and training.Our team has optimized kernels serving billions of tokens daily, designed distributed training systems coordinating 10,000+ GPUs, and contributed to infrastructure that powers leading AI companies and research labs.We’re backed by well-known infrastructure investors and partner with Nvidia, Google, AWS, and frontier AI labs.

Join us in building infrastructure that gives real leverage back to the AI community.

Compensation

We offer competitive compensation with meaningful equity, comprehensive benefits, and flexible work arrangements. Compensation depends on location, experience, and level.

Equal Opportunity

RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Member of Technical Staff — Inference-Core Engine
Member of Technical Staff — Inference-Core Engine

RadixArk • Palo Alto (CA)

Vor Ort
USD 200.000 - 400.000
Member of Technical Staff — Developer Experience
Member of Technical Staff — Developer Experience

RadixArk • Iowa

Vor Ort
USD 200.000 - 400.000
Product Marketing Manager
Product Marketing Manager

RadixArk • Palo Alto (CA)

Vor Ort
USD 160.000 - 300.000
Business Development
Business Development

RadixArk • Palo Alto (CA)

Vor Ort
USD 160.000 - 300.000
Staff Engineer, DevTech: Fast AI Inference on GPUs
Staff Engineer, DevTech: Fast AI Inference on GPUs

RadixArk • Palo Alto (CA)

Vor Ort
USD 180.000 - 240.000
Equity
Flexible work arrangements
Inference Research Engineer (MTS)
Inference Research Engineer (MTS)

Coral Bricks AI • San Francisco (CA)

Vor Ort
USD 120.000 - 200.000
Health, dental and vision insurance
Flexible time off
Equity
Senior Principal Software Engineer, LLM Inference & GPU Optimization
Senior Principal Software Engineer, LLM Inference & GPU Optimization

People In AI • USA

Remote
USD 230.000 - 280.000
Bonus
Equity
Remote work within United States
LLM Inference Engineer
LLM Inference Engineer

Majestic Labs ai • Los Altos (CA)

Vor Ort
USD 210.000 - 350.000
Senior Staff LLM Inference Engineer
Senior Staff LLM Inference Engineer

d-Matrix • Santa Clara (CA)

Hybrid
USD 195.000 - 285.000
ML Systems, LLM Post-Training
ML Systems, LLM Post-Training

ChipAgents • San Jose (CA)

Vor Ort
USD 150.000 - 350.000
Equity
Unlimited PTO
Full benefits
+1