Lead ML Network Stack Engineer for Scalable EC2 AI

Amazon; Cupertino (CA); On-site; USD 193,000 - 262,000; Full time

Benefits offered by this job

Health insurance

RSUs and sign-on options

401(k) matching

Paid time off

Parental leave

Job summary

Amazon’s Annapurna Labs team seeks a Lead Software Engineer to own the ML network stack for EC2 distributed AI/ML systems. You will lead senior, mid-level, and junior engineers, coordinating across ML communication libraries and CUDA kernels to enable NVIDIA GPUs on EC2, while driving features for the largest ML workloads.

We value deep Linux and networking expertise, fast iteration, and mentorship. This role offers growth toward a SDM path within a supportive, inclusive AWS culture.

Qualifications

• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems
• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Experience as a mentor, tech lead or leading an engineering team, or experience in development in the last 3 years
• 5+ years of experience with programming language: C or C++

Responsibilities

• Be the Leader which works across the NVIDIA ML communication stack for enabling NVIDIA GPUs to work with the AWS EC2 machines.
• You’ll be leading senior, mid-level, and junior SDEs and directing work to ensure the team delivers functions and features required for the latest and largest ML workloads.

Skills

Leadership experience across design/AR

SDLC experience

Mentorship/tech lead

C/C++ proficiency

Education

Bachelor's degree in CS or equivalent

Tools

NCCL

NVSHMEM

NIXL

NCCL GIN

CUDA kernels

Job description

Amazon’s Annapurna Labs team seeks a Lead Software Engineer to own the ML network stack for EC2 distributed AI/ML systems. You will lead senior, mid-level, and junior engineers, coordinating across ML communication libraries and CUDA kernels to enable NVIDIA GPUs on EC2, while driving features for the largest ML workloads.

We value deep Linux and networking expertise, fast iteration, and mentorship. This role offers growth toward a SDM path within a supportive, inclusive AWS culture.