AI/ML Systems Engineer — Distributed Training

Amazon Web Services (AWS); Seattle (WA); On-site; USD 144,000 - 194,000; Full time

Job summary

Annapurna Labs (U.S.) Inc. at AWS is seeking engineers to optimize distributed training on Trainium and improve throughput across the Neuron stack. You will own data, tensor, and other parallelism strategies and work with PyTorch and JAX to push performance.

The role requires deep ML, HPC expertise and collaboration with compiler, runtime, and framework teams to land impactful improvements for customers training frontier models.

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture experience.
• Experience programming with at least one programming language.

Responsibilities

• Optimize distributed training performance on Trainium across the Neuron software stack.
• Own parallelism strategies: data, tensor, pipeline, expert, and context parallelism.
• Profile end-to-end workloads to identify bottlenecks and drive fixes with compiler/runtime teams.
• Translate performance gaps into framework requirements and contribute upstream.

Skills

Software development

Design/Architecture

Programming languages

Education

Bachelor's degree in computer science or equivalent

Job description

Annapurna Labs (U.S.) Inc. at AWS is seeking engineers to optimize distributed training on Trainium and improve throughput across the Neuron stack. You will own data, tensor, and other parallelism strategies and work with PyTorch and JAX to push performance.

The role requires deep ML, HPC expertise and collaboration with compiler, runtime, and framework teams to land impactful improvements for customers training frontier models.