Senior AI/ML Distributed Training Engineer (Trainium)

Annapurna Labs (U.S.) Inc.

Cupertino (CA)

On-site

USD 200,000 - 300,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Annapurna Labs (U.S.) Inc. at Amazon Web Services (AWS) seeks a technical leader to build and optimize distributed training for Trainium accelerators.

You will collaborate across PyTorch, JAX, and the Neuron stack to enable large-scale training, post-training, and RL workloads while shaping parallelism strategies. The role combines ML, HPC, and distributed systems, offering opportunities to influence frameworks and contribute upstream to open-source projects.

Qualifications

  • 5+ years of non-internship professional software development experience.
  • 5+ years of programming with at least one software programming language experience.
  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
  • Experience as a mentor, tech lead or leading an engineering team.
  • Bachelor's degree or above in computer science or equivalent.
  • Familiarity with LLM/transformer fundamentals such as attention mechanisms, autoregressive decoding, V-cache behavior, forms of parallelism.
  • Experience in machine learning, data mining, information retrieval, statistics or natural language processing.

Responsibilities

  • Lead the effort to build distributed training and post-training support into PyTorch and JAX for Trainium accelerators.
  • Work across PyTorch and Neuron software stack with the Neuron compiler and runtime teams to enable and fine tune large-scale training, post training, and reinforcement learning workloads on the latest Trainium instances.
  • Own the parallelism strategies these models depend on, spanning data, tensor, pipeline, expert, and context parallelism, and apply reduced-precision formats where they measurably pay off.
  • Profile end to end to determine whether a workload is bound by compute, memory, collectives, or host overhead, then drive the fix to the layer that owns it, working with compiler, runtime, and collectives engineers to land it.
  • Translate the performance gaps you characterize into requirements that influence frameworks, and contribute upstream to the open source frameworks our customers train on.

Skills

Mentorship/tech lead
Leadership
LLM fundamentals
Machine Learning
Data mining
Information retrieval
Statistics
NLP

Education

Bachelor's degree in computer science or equivalent
Master's degree in computer science or equivalent

Tools

PyTorch
JAX
Distributed libraries/Frameworks
RL frameworks

Job description

Annapurna Labs (U.S.) Inc. at Amazon Web Services (AWS) seeks a technical leader to build and optimize distributed training for Trainium accelerators.

You will collaborate across PyTorch, JAX, and the Neuron stack to enable large-scale training, post-training, and RL workloads while shaping parallelism strategies. The role combines ML, HPC, and distributed systems, offering opportunities to influence frameworks and contribute upstream to open-source projects.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead AI/ML Distributed Training Engineer on Trainium
Lead AI/ML Distributed Training Engineer on Trainium

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
AI/ML Systems Engineer – Distributed Training on Trainium
AI/ML Systems Engineer – Distributed Training on Trainium

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 165,000 - 224,000
AI/ML Software Engineer – Distributed Training on Trainium
AI/ML Software Engineer – Distributed Training on Trainium

Amazon Inc. • Seattle (WA)

On-site
USD 144,000 - 194,000
AI/ML Software Engineer - Trainium Distributed Training
AI/ML Software Engineer - Trainium Distributed Training

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
AI/ML Software Engineer — Trainium Distributed Training
AI/ML Software Engineer — Trainium Distributed Training

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 144,000 - 194,000
Health insurance
401(k) matching
Paid time off
+1
Lead ML Systems Engineer – AI/GenAI Acceleration
Lead ML Systems Engineer – AI/GenAI Acceleration

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
RSUs (restricted stock units)
401(k) matching
+2
Senior AI/ML Systems Engineer - Distributed Training
Senior AI/ML Systems Engineer - Distributed Training

Amazon Web Services • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
Paid time off
+2
Software Engineer - AI Training Systems (Trainium)
Software Engineer - AI Training Systems (Trainium)

Amazon Inc. • Seattle (WA)

On-site
USD 165,000 - 224,000
Senior Software Engineer - AI Training Collectives
Senior Software Engineer - AI Training Collectives

Amazon Inc. • Cupertino (CA)

Hybrid
USD 193,000 - 262,000
RSUs
Sign-on payments
Health insurance
Software Engineer - AI Training Collectives (Trainium)
Software Engineer - AI Training Collectives (Trainium)

Annapurna Labs • Cupertino (CA)

On-site
USD 165,000 - 224,000
Sign-on payments / RSUs
Health insurance (medical, dental, etc
401(k) matching
+2