Senior ML Networking & HPC Stack Lead

Amazon; Cupertino (CA); On-site; USD 193,300 - 261,500; Full time

Job summary

Amazon's Annapurna Labs in Cupertino seeks a Lead Software Engineer to own the ML network stack for EC2 distributed AI/ML systems, working on NCCL, NVSHMEM, NIXL, CUDA kernels and high‑speed interconnects. You will influence architecture and mentor a team of SDEs across senior, mid‑level and junior levels.

The role centers on Linux, networking and high performance software, delivering scalable features for the largest clusters and models.

Qualifications

• 5+ years leading design or architecture of scalable systems.
• 5+ years SDLC including coding standards, reviews, builds, testing and operations.
• Experience mentoring or leading an engineering team in the last 3 years.

Responsibilities

• Lead across the NVIDIA ML communication stack to enable NVIDIA GPUs on AWS EC2 machines.
• Mentor senior, mid-level, and junior SDEs and drive features for ML workloads.
• Collaborate with cross‑team stakeholders to deliver scalable networking components for ML workloads.

Skills

Leadership

Mentoring

C/C++

SDLC

Education

Bachelor's degree in Computer Science or equivalent

Job description

Amazon's Annapurna Labs in Cupertino seeks a Lead Software Engineer to own the ML network stack for EC2 distributed AI/ML systems, working on NCCL, NVSHMEM, NIXL, CUDA kernels and high‑speed interconnects. You will influence architecture and mentor a team of SDEs across senior, mid‑level and junior levels.

The role centers on Linux, networking and high performance software, delivering scalable features for the largest clusters and models.