AI/ML Systems Engineer – Distributed Training on Trainium

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 165,000 - 224,000; Full time

Job summary

Annapurna Labs (U.S.) Inc. within AWS is seeking engineers to optimize distributed training on Trainium. You will work across PyTorch and Neuron stack with compiler and runtime teams to improve training throughput on AWS accelerators.

The role focuses on defining parallelism strategies, profiling workloads, and translating performance gaps into framework requirements, contributing upstream to open-source projects.

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of design or architecture (design patterns, reliability and scaling) of new and existing systems.
• Experience programming with at least one software programming language.

Responsibilities

• Lead optimization of distributed training performance across the Neuron software stack for Trainium.
• Own parallelism strategies across data, tensor, pipeline, expert, and context parallelism.
• Profile workloads to determine bottlenecks and drive fixes with compiler, runtime, and collectives teams.

Skills

Software development

System design

Programming languages

Education

Bachelor's degree in CS

Job description

Annapurna Labs (U.S.) Inc. within AWS is seeking engineers to optimize distributed training on Trainium. You will work across PyTorch and Neuron stack with compiler and runtime teams to improve training throughput on AWS accelerators.

The role focuses on defining parallelism strategies, profiling workloads, and translating performance gaps into framework requirements, contributing upstream to open-source projects.