Lead Software Engineer, ML Network Stack - Annapurna Labs

Amazon Web Services (AWS)

Cupertino (CA)

On-site

USD 180,000 - 240,000

Full time

7 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Sign-on payments

RSUs

Health Insurance

Medical Insurance

Dental Insurance

Vision Insurance

Prescription Insurance

Life & AD&D Insurance

Supplemental Life Plans

EAP

Mental Health Support

Medical Advice Line

FSAs

Adoption and Surrogacy Reimbursement

401(k) Matching

Paid Time Off

Parental Leave

Job summary

Amazon Web Services in Cupertino, CA leads the development of the network stack for EC2 distributed AI/ML systems, enabling NVIDIA GPUs to work with AWS machines. You will direct a team of engineers to deliver features for the largest AI models and workloads.

The role requires 5+ years in system design and the software development lifecycle, with strong C/C++ background and prior tech-lead/mentorship experience.

Qualifications

Requires 5+ years of experience in system design, software development life cycle, and programming in C or C++.
Experience as a tech lead or mentor is required; mentorship preferred.
Knowledge of ML communication libraries or RDMA networking is highly desirable.

Responsibilities

Lead the development of the network stack for EC2 distributed AI/ML systems, enabling NVIDIA GPUs to work with AWS machines.
Direct a team of software engineers to deliver features for the largest AI models and ML workloads.

Skills

C++

ML Networking

RDMA

NCCL

NVSHMEM

NIXL

CUDA Kernels

Linux

Distributed Systems

System Architecture

Software Development Life Cycle

HPC

Embedded Systems

Technical Leadership

Network Stack

Job description

Lead the development of the network stack for EC2 distributed AI/ML systems, specifically enabling NVIDIA GPUs to work with AWS machines. Direct a team of software engineers to deliver features required for the largest AI models and ML workloads.

Requirements

Requires 5+ years of experience in system design, software development life cycle, and programming in C or C++. Candidates must have experience as a tech lead or mentor and preferably have knowledge of ML communication libraries or RDMA networking.

Key Skills