AI/ML Systems Engineer – Distributed Training on Trainium

Amazon Web Services (AWS)

Cupertino (CA)

On-site

USD 165,000 - 224,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Annapurna Labs (U.S.) Inc. within AWS is seeking engineers to optimize distributed training on Trainium. You will work across PyTorch and Neuron stack with compiler and runtime teams to improve training throughput on AWS accelerators.

The role focuses on defining parallelism strategies, profiling workloads, and translating performance gaps into framework requirements, contributing upstream to open-source projects.

Qualifications

  • 3+ years of non-internship professional software development experience.
  • 2+ years of design or architecture (design patterns, reliability and scaling) of new and existing systems.
  • Experience programming with at least one software programming language.

Responsibilities

  • Lead optimization of distributed training performance across the Neuron software stack for Trainium.
  • Own parallelism strategies across data, tensor, pipeline, expert, and context parallelism.
  • Profile workloads to determine bottlenecks and drive fixes with compiler, runtime, and collectives teams.

Skills

Software development
System design
Programming languages

Education

Bachelor's degree in CS

Job description

Annapurna Labs (U.S.) Inc. within AWS is seeking engineers to optimize distributed training on Trainium. You will work across PyTorch and Neuron stack with compiler and runtime teams to improve training throughput on AWS accelerators.

The role focuses on defining parallelism strategies, profiling workloads, and translating performance gaps into framework requirements, contributing upstream to open-source projects.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI/ML Software Engineer – Distributed Training on Trainium
AI/ML Software Engineer – Distributed Training on Trainium

Amazon Inc. • Seattle (WA)

On-site
USD 144,000 - 194,000
AI/ML Software Engineer - Trainium Distributed Training
AI/ML Software Engineer - Trainium Distributed Training

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Lead AI/ML Distributed Training Engineer on Trainium
Lead AI/ML Distributed Training Engineer on Trainium

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
AI/ML Software Engineer — Trainium Distributed Training
AI/ML Software Engineer — Trainium Distributed Training

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
Lead ML Systems Engineer – AI/GenAI Acceleration
Lead ML Systems Engineer – AI/GenAI Acceleration

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
RSUs (restricted stock units)
401(k) matching
+2
Software Engineer - AI Training Systems (Trainium)
Software Engineer - AI Training Systems (Trainium)

Amazon Inc. • Seattle (WA)

On-site
USD 165,000 - 224,000
Senior AI/ML Systems Engineer - Distributed Training
Senior AI/ML Systems Engineer - Distributed Training

Amazon Web Services • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
+2
Software Engineer - AI Training Collectives (Trainium)
Software Engineer - AI Training Collectives (Trainium)

Annapurna Labs • Cupertino (CA)

On-site
USD 165,000 - 224,000
Sign-on payments / RSUs
Health insurance (medical, dental, etc
401(k) matching
+2
AI/ML Systems Engineer for AWS Neuron Inference
AI/ML Systems Engineer for AWS Neuron Inference

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
Senior Software Engineer - AI Training Collectives
Senior Software Engineer - AI Training Collectives

Amazon Inc. • Cupertino (CA)

Hybrid
USD 193,000 - 262,000
RSUs
Sign-on payments
Health insurance