ML Distributed Training Engineer for Trainium Accelerators

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 165,200 - 223,600; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Job summary

Annapurna Labs, part of AWS, is seeking a software engineer to advance distributed training on Trainium and Neuron. You will work with cutting-edge ML models and collaborate with chip architects, compiler engineers, and runtime teams to push performance and efficiency at scale.

Based in Cupertino, CA, this role emphasizes optimization across software stacks and mentorship within a diverse, inclusive team culture. A Bachelor’s degree in CS or equivalent is required.

Qualifications

• 3+ years of non‑internship professional software development experience.
• 2+ years design or architecture (design patterns, reliability and scaling) of systems.
• Experience programming with at least one software programming language.

Responsibilities

• Lead efforts to optimize distributed training performance on Trainium, maximizing throughput and efficiency.
• Collaborate across PyTorch, JAX, and the Neuron compiler/runtime to enable large-scale training workloads.
• Identify and resolve bottlenecks across the stack from communications to kernel performance.

Skills

Software development

System design / architecture

Programming languages

Education

Bachelor's degree in computer science or equivalent

Job description

Annapurna Labs, part of AWS, is seeking a software engineer to advance distributed training on Trainium and Neuron. You will work with cutting-edge ML models and collaborate with chip architects, compiler engineers, and runtime teams to push performance and efficiency at scale.

Based in Cupertino, CA, this role emphasizes optimization across software stacks and mentorship within a diverse, inclusive team culture. A Bachelor’s degree in CS or equivalent is required.