AI/ML Software Engineer - Distributed Training HPC

Amazon; Cupertino, Northern (CA, KY); Hybrid; USD 165,000 - 224,000; Full time

Job summary

Amazon’s Annapurna Labs team within AWS Neuron Training seeks a Software Engineer to optimize distributed training on Trainium, tackling throughput across the Neuron stack and collaborating with PyTorch and JAX integrations. You will own parallelism strategies and help land improvements across compiler, runtime, and collectives teams.

The role emphasizes performance tuning, end-to-end profiling, and upstream contributions to open source frameworks used by customers training frontier models on

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• Experience programming with at least one software programming language.
• Bachelor's degree in computer science or equivalent.

Responsibilities

• Lead the effort to optimize distributed training performance on Trainium, focusing on training throughput across the Neuron software stack.
• Collaborate across PyTorch and Neuron tooling to enable and tune large-scale training workloads on the latest Trainium instances.

Skills

Non-internship software development

System design/architecture

Programming languages

Education

Bachelor's degree in computer science or equivalent

Job description

Amazon’s Annapurna Labs team within AWS Neuron Training seeks a Software Engineer to optimize distributed training on Trainium, tackling throughput across the Neuron stack and collaborating with PyTorch and JAX integrations. You will own parallelism strategies and help land improvements across compiler, runtime, and collectives teams.

The role emphasizes performance tuning, end-to-end profiling, and upstream contributions to open source frameworks used by customers training frontier models on