Senior ML Networking Architect for Large-Scale EC2 Systems

Amazon Inc.

Cupertino (CA)

On-site

USD 260,000 - 380,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Annapurna Labs, an integral part of AWS, seeks an experienced engineer and technical leader to own the network stack for EC2 distributed AI/ML systems. The team develops support for NCCL, NVSHMEM, NIXL, NCCL GIN, and CUDA kernels, with strong emphasis on Linux, networking and performant coding.

You will lead senior, mid-level, and junior SDEs, directing work to deliver scalable functions and features for the latest ML workloads, partnering across teams to enable GPUs to work with EC2 instances.

Qualifications

  • 5+ years of leading design or architecture of new and existing systems.
  • 5+ years of experience with programming language: C or C++.
  • Experience mentoring or leading an engineering team.
  • Bachelor's degree in computer science or equivalent.

Responsibilities

  • Be the Leader which works across the NVIDIA ML communication stack for enabling NVIDIA GPUs to work with the AWS EC2 machines.
  • Lead senior, mid-level, and junior SDEs and direct work to deliver functions and features for the latest ML workloads.
  • Collaborate across teams to optimize ML networking and RDMA interconnects for EC2 infrastructure.

Skills

Leadership experience
C/C++ programming
Mentorship
Software development lifecycle

Education

Bachelor's degree in computer science or equivalent

Tools

RDMA Networking
ML Communication Libraries

Job description

Annapurna Labs, an integral part of AWS, seeks an experienced engineer and technical leader to own the network stack for EC2 distributed AI/ML systems. The team develops support for NCCL, NVSHMEM, NIXL, NCCL GIN, and CUDA kernels, with strong emphasis on Linux, networking and performant coding.

You will lead senior, mid-level, and junior SDEs, directing work to deliver scalable functions and features for the latest ML workloads, partnering across teams to enable GPUs to work with EC2 instances.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Network Stack Lead Engineer
ML Network Stack Lead Engineer

About Amazon • Seattle (WA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
+1
Lead Software Engineer, ML Network Stack - Annapurna Labs
Lead Software Engineer, ML Network Stack - Annapurna Labs

Amazon Inc. • Cupertino (CA)

On-site
USD 260,000 - 380,000
Distributed AI/ML Systems Engineer
Distributed AI/ML Systems Engineer

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 180,000 - 240,000
Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives
Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives

Amazon Web Services • Cupertino (CA)

On-site
USD 180,000 - 240,000
Software Development Engineer, Annapurna Labs, Elastic Collectives at Annapurna Labs (U.S.) Inc. Cupertino, CA
Software Development Engineer, Annapurna Labs, Elastic Collectives at Annapurna Labs (U.S.) Inc. Cupertino, CA

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 140,000 - 200,000
Senior ML Systems Engineer: EC2 Nitro & HW/SW Co-Design
Senior ML Systems Engineer: EC2 Nitro & HW/SW Co-Design

Amazon Web Services (AWS) • Santa Clara (CA)

On-site
USD 180,000 - 300,000
Sign-on payments
Restricted stock units (RSUs)
Health insurance
+14
Distributed AI/ML Systems Engineer (HPC, C/C++)
Distributed AI/ML Systems Engineer (HPC, C/C++)

Annapurna Labs • Cupertino (CA)

On-site
USD 150,000 - 250,000
Senior Systems Engineer - High-Performance Networking
Senior Systems Engineer - High-Performance Networking

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 193,000 - 262,000
Health insurance
Stock options
Senior ML Platform Engineer, EC2 Nitro
Senior ML Platform Engineer, EC2 Nitro

Amazon Inc. • Santa Clara (CA)

On-site
USD 150,000 - 210,000
Software Development Engineer, Annapurna Labs, Elastic Collectives
Software Development Engineer, Annapurna Labs, Elastic Collectives

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 180,000 - 240,000