Lead ML Network Stack Engineer (RDMA, CUDA, NCCL)

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Sign-on payments

RSUs

Health Insurance

Medical Insurance

Dental Insurance

Vision Insurance

Prescription Insurance

Life & AD&D Insurance

Supplemental Life Plans

EAP

Mental Health Support

Medical Advice Line

FSAs

Adoption and Surrogacy Reimbursement

401(k) Matching

Paid Time Off

Parental Leave

Job summary

Amazon Web Services in Cupertino, CA leads the development of the network stack for EC2 distributed AI/ML systems, enabling NVIDIA GPUs to work with AWS machines. You will direct a team of engineers to deliver features for the largest AI models and workloads.

The role requires 5+ years in system design and the software development lifecycle, with strong C/C++ background and prior tech-lead/mentorship experience.

Qualifications

• Requires 5+ years of experience in system design, software development life cycle, and programming in C or C++.
• Experience as a tech lead or mentor is required; mentorship preferred.
• Knowledge of ML communication libraries or RDMA networking is highly desirable.

Responsibilities

• Lead the development of the network stack for EC2 distributed AI/ML systems, enabling NVIDIA GPUs to work with AWS machines.
• Direct a team of software engineers to deliver features for the largest AI models and ML workloads.

Skills

C

C++

ML Networking

RDMA

NCCL

NVSHMEM

NIXL

CUDA Kernels

Linux

Distributed Systems

System Architecture

Software Development Life Cycle

HPC

Embedded Systems

Technical Leadership

Network Stack

Job description

Amazon Web Services in Cupertino, CA leads the development of the network stack for EC2 distributed AI/ML systems, enabling NVIDIA GPUs to work with AWS machines. You will direct a team of engineers to deliver features for the largest AI models and workloads.

The role requires 5+ years in system design and the software development lifecycle, with strong C/C++ background and prior tech-lead/mentorship experience.