Software Engineer — AI/ML Networking for Inference

Amazon Inc.

Cupertino (CA)

Presencial

USD 180 000 - 240 000

Tempo integral

Há 6 dias

Torna-te num dos primeiros candidatos

Gerador de candidaturas

Uma candidatura feita para esta oferta — um currículo e uma carta de apresentação personalizados que vão ao encontro do anúncio.

Ultrapassa os filtros ATS

Resumo da oferta

Annapurna Labs in Cupertino, part of AWS, is seeking a Software Development Engineer focused on AI/ML networking disaggregated inference. You will build data-m movement software across accelerators and servers, profile workloads, and collaborate across the stack from network transport to inference frameworks.

Strong C/C++ and Linux skills are required, with a passion for performance and the ability to push hardware limits.

Qualificações

Strong C/C++ and Linux experience in performance-critical systems.
Interest in low-level software and ability to measure and optimize performance.
Exposure to high-speed networking or HPC interconnects is a strong plus; embedded-systems experience welcome.
Prior AI/ML experience is not required; strong systems engineer willing to learn the ML side.

Responsabilidades

Build and optimize low-level data-movement software transferring KV cache and activations across accelerators and servers over AWS's high-performance fabric.
Profile workloads, identify bottlenecks, and push components toward hardware limits.
Work across the stack—from network transport to inference frameworks—collaborating with chip, runtime, and model teams.
Deliver features to large-scale clusters for major customers and AI models in production.