AI/ML Software Engineer – Distributed Training on Trainium

Amazon Inc.

Seattle (WA)

On-site

USD 144,000 - 194,000

Full time

4 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Amazon’s Annapurna Labs/AWS Neuron Training team seeks a Software Engineer to advance distributed training on Trainium. You will optimize throughput across the Neuron stack, collaborate with PyTorch and JAX teams, and shape parallelism strategies from data to tensor to pipeline levels.

The role blends ML, HPC, and systems engineering to push training performance at scale. You will profile workloads, land fixes across compiler, runtime, and collectives, and help customers train frontier models

Qualifications

3+ years of non-internship professional software development experience.
2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
Experience programming with at least one software programming language.

Responsibilities

Your role will help lead the effort to optimize distributed training performance on Trainium, with a primary focus on training throughput across the Neuron software stack.
You will own the parallelism strategies these models depend on, spanning data, tensor, pipeline, expert, and context parallelism.
You will profile end-to-end to determine whether a workload is bound by compute, memory, collectives, or host overhead, then drive the fix to the layer that owns it.