Distributed AI/ML Systems Engineer

Annapurna Labs (U.S.) Inc.

Cupertino (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Annapurna Labs, part of AWS, seeks an experienced engineer to advance distributed AI/ML systems. You will work on collective operations, primarily in C/C++ on Linux, emphasizing high performance for large clusters and AI models.

Embedded experience is valued, with a focus on scalable HPC networking for ML workloads. You will collaborate across disciplines in a globally distributed team, with mentorship, code reviews, and career growth opportunities.

Qualifications

  • 3+ years of non-internship professional software development experience.
  • 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems.
  • Experience programming with at least one software programming language.

Responsibilities

  • Develop distributed AI/ML systems and collective operations critical for scaling across accelerators and servers.
  • Work on low-level C/C++ components, focusing on performance and reliability in Linux environments.
  • Collaborate with diverse teams including hardware, RTL, and software engineers to deliver scalable HPC networking solutions for ML workloads.

Skills

Software development
System design
C/C++ programming

Education

Bachelor's degree in computer science or equivalent

Tools

Linux

Job description

Annapurna Labs, part of AWS, seeks an experienced engineer to advance distributed AI/ML systems. You will work on collective operations, primarily in C/C++ on Linux, emphasizing high performance for large clusters and AI models.

Embedded experience is valued, with a focus on scalable HPC networking for ML workloads. You will collaborate across disciplines in a globally distributed team, with mentorship, code reviews, and career growth opportunities.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Distributed AI/ML Systems Engineer (HPC, C/C++)
Distributed AI/ML Systems Engineer (HPC, C/C++)

Annapurna Labs • Cupertino (CA)

On-site
USD 150,000 - 250,000
Distributed AI/ML Systems Engineer — HPC & Networking
Distributed AI/ML Systems Engineer — HPC & Networking

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 140,000 - 200,000
Software Development Engineer, Annapurna Labs, Elastic Collectives at Annapurna Labs (U.S.) Inc. Cupertino, CA
Software Development Engineer, Annapurna Labs, Elastic Collectives at Annapurna Labs (U.S.) Inc. Cupertino, CA

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 140,000 - 200,000
Senior ML Networking Architect for Large-Scale EC2 Systems
Senior ML Networking Architect for Large-Scale EC2 Systems

Amazon Inc. • Cupertino (CA)

On-site
USD 260,000 - 380,000
AI-Driven Cloud Systems Engineer
AI-Driven Cloud Systems Engineer

Amazon Web Services (AWS) • Austin (TX)

On-site
USD 129,000 - 175,000
AI/ML Systems Engineer – High-Performance Networking
AI/ML Systems Engineer – High-Performance Networking

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 165,000 - 224,000
Health insurance
401(k) matching
Paid time off
+1
ML Systems Software Engineer — High-Performance AI
ML Systems Software Engineer — High-Performance AI

Talemexa • New York (NY)

On-site
USD 150,000 - 210,000
Software Development Engineer, Annapurna Labs, Elastic Collectives
Software Development Engineer, Annapurna Labs, Elastic Collectives

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 180,000 - 240,000
Software Engineer — AI/ML Networking for Inference
Software Engineer — AI/ML Networking for Inference

Amazon Inc. • Cupertino (CA)

On-site
USD 180,000 - 240,000
Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives
Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives

Amazon Web Services • Cupertino (CA)

On-site
USD 180,000 - 240,000