Une candidature complète en une minute
Un CV et une lettre de motivation personnalisés, prêts à envoyer.
Zenlayer, Inc. is seeking a Technical Lead for inference performance to own end-to-end Token Performance. You will reduce cost per million tokens and increase per-GPU goodput while meeting SLOs across models from billions to trillions of parameters.
The role requires deep knowledge of Transformer inference, kernel-level optimization, and orchestration boundaries. You will drive disaggregation, explore MoE parallelism, and optimize CUDA kernels across GPUs.
Zenlayer is the first massively distributed edge cloud provider, operating 290+ Points of Presence across 70+ countries. With accolades including PTC "Best Networking Innovation", "Outstanding Cloud, Data Center, or Interconnection Company", and Inc. 5000, we enable businesses to deploy and run applications at the edge, thus reducing network latency to the end user. Zenlayer focuses on improving connections worldwide, all while nurturing a unique company culture that values service, growth, and trust. As a "Zenplayer", you’ll be joining a community of success-driven team players that share the dream of powering a better-connected world.
As the technical lead for inference performance, you will own end-to-end responsibility for the platform's Token Performance. For models ranging from hundreds of billions to trillions of parameters (including MoE), you will continuously reduce cost per million tokens and increase per-GPU Goodput while meeting TTFT/TPOT SLOs, and prove the gain from every optimization with reproducible data.
First-principles understanding of Transformer inference: the compute vs. memory-bound nature of Prefill and Decode, the KV Cache memory model, the differences among MHA/GQA/MLA, and how MoE routing constrains parallelism Source-level, in-depth experience with at least one mainstream inference engine, with real cases of identifying and fixing bottlenecks in scheduling, kernel selection, or KV management CUDA kernel tuning skills (Nsight profiling, memory optimization, fusion, CUDA Graph) with hands-on practical experience Bachelor’s degree in Computer Science, Electrical/Computer Engineering, or related field (HPC systems, ML Systems). Minimum 6 years in systems/Performance Engineering, with at least 2-3 years directly on LLM or GPU performance work Preferred, but not required: Experience with Merged PRs in vLLM Experience operating at cluster sale (hundreds to thousands of GPUs)