Senior Distributed AI/ML Systems Engineer

Amazon; Cupertino (CA); On-site; USD 180,000 - 230,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

RSU / stock incentives

Job summary

Amazon is seeking an experienced software engineer to work on distributed AI/ML systems within Annapurna Labs. You will focus on collective operations across accelerators and servers, with a strong emphasis on C/C++ and low-level Linux performance.

Embedded systems and high-speed networking experience are valued. You will join a team that designs hardware and software building blocks for EC2 infrastructure, collaborating across hardware, RTL, and software engineers.

Qualifications

• 5+ years of professional software development experience
• 5+ years of programming in C/C++
• 5+ years of design/architecture experience
• 5+ years of SDLC, reviews, source control, builds, testing, operations
• Experience mentoring or leading an engineering team
• Must have C/C++ coding experience
• Bachelor's degree in CS or equivalent
• ML communications libraries (NCCL, NIXL, NVSHMEM)

Responsibilities

• Develop and optimize distributed AI/ML systems for scale across accelerators and servers
• Work on collective operations powering EC2 infrastructure
• Collaborate with hardware, RTL, and software teams to build high-performance networking solutions for ML/HPC workloads on AWS
• Mentor junior engineers and contribute to architectural decisions
• Deliver features for large-scale AI models and clusters

Skills

C/C++ Coding

Linux

Kernels

Embedded systems

Networking / HPC interconnects

Mentorship / Tech lead

Education

Bachelor's degree in CS or equivalent

Tools

NCCL / NVSHMEM / NCCL-based

Job description

Amazon is seeking an experienced software engineer to work on distributed AI/ML systems within Annapurna Labs. You will focus on collective operations across accelerators and servers, with a strong emphasis on C/C++ and low-level Linux performance.

Embedded systems and high-speed networking experience are valued. You will join a team that designs hardware and software building blocks for EC2 infrastructure, collaborating across hardware, RTL, and software engineers.