ML Systems Engineer - Distributed Training on Trainium

Amazon; Cupertino (CA); On-site; USD 165,000 - 224,000; Full time

Benefits offered by this job

Health insurance

RSUs

Sign-on bonuses

Job summary

Amazon Web Services (AWS) is seeking a software engineer for the Distributed Training team in Annapurna Labs to optimize distributed training performance on Trainium. You will work on leveraging PyTorch, JAX, and the Neuron compiler/runtime to scale large models and accelerate training throughput.

The role involves collaboration with chip architects, compiler engineers, and runtime engineers to resolve bottlenecks and push training efficiency across the stack, including memory, communications,

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture of new/existing systems.
• Experience programming with at least one software language.

Responsibilities

• Lead efforts to optimize distributed training performance on Trainium.
• Maximize training throughput and model FLOPs utilization.
• Collaborate across PyTorch, JAX, and Neuron compiler/runtime to enable large-scale training workloads.

Skills

Software development

System design

Programming languages

Education

Bachelor's degree in CS or equivalent

Job description

Amazon Web Services (AWS) is seeking a software engineer for the Distributed Training team in Annapurna Labs to optimize distributed training performance on Trainium. You will work on leveraging PyTorch, JAX, and the Neuron compiler/runtime to scale large models and accelerate training throughput.

The role involves collaboration with chip architects, compiler engineers, and runtime engineers to resolve bottlenecks and push training efficiency across the stack, including memory, communications,