AI/ML Software Engineer — Trainium Distributed Training

Amazon Web Services (AWS); Seattle (WA); On-site; USD 144,000 - 194,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Web Services (AWS) Annapurna Labs team is hiring to advance AWS Neuron for Trainium. You will drive performance, collaborating with compiler, runtime, and frameworks teams to optimize large-scale training workloads.

The role involves owning parallelism strategies across data, tensor, pipeline, expert, and context parallelism, applying reduced precision where it pays off, and profiling workloads to land fixes with cross-team input.

Qualifications

• 3+ years of non-internship software development experience.
• 2+ years of non-internship design or architecture (patterns, reliability, scaling).
• Experience programming with at least one software programming language.

Responsibilities

• Lead in optimizing distributed training performance on Trainium with a focus on training throughput across the Neuron software stack.
• Collaborate across PyTorch and Neuron stacks to enable and tune large-scale training workloads on latest Trainium instances.
• Own parallelism strategies (data, tensor, pipeline, expert, context) and apply reduced-precision formats where beneficial.

Skills

3+ years of non-internship software de

2+ years of design or architecture

Experience programming in at least one

Education

Bachelor's degree in computer science or equivalent

Job description

Amazon Web Services (AWS) Annapurna Labs team is hiring to advance AWS Neuron for Trainium. You will drive performance, collaborating with compiler, runtime, and frameworks teams to optimize large-scale training workloads.

The role involves owning parallelism strategies across data, tensor, pipeline, expert, and context parallelism, applying reduced precision where it pays off, and profiling workloads to land fixes with cross-team input.