Senior AI/ML Systems Engineer - Distributed Training

Amazon; Cupertino (CA); On-site; USD 193,000 - 262,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

RSUs

Parental leave

Job summary

Amazon Neuron Training in Cupertino seeks a Sr. Software Engineer to lead distributed training efforts for Trainium accelerators.

You will work across PyTorch and JAX to enable large-scale training, post-training, and RL workflows, owning parallelism strategies and driving performance improvements with compiler, runtime, and framework teams. Ideal candidates bring 5+ years of software leadership, deep ML experience, and a strong background in distributed systems.

Qualifications

• 5+ years of professional software development experience.
• Experience leading design or architecture of distributed systems.
• Mentor or tech lead experience and Bachelor's degree or above.

Responsibilities

• Lead distributed training and post-training support in PyTorch and JAX for Trainium.
• Collaborate across PyTorch and Neuron to enable large-scale training workflows.
• Own parallelism strategies: data, tensor, pipeline, expert, and context.
• Profile workloads to identify bottlenecks and drive fixes with teams.

Skills

Distributed systems

Machine learning

Leadership

Python

C++

Education

Bachelor's degree in computer science or equivalent

Master's degree (preferred)

Tools

PyTorch

JAX

Job description

Amazon Neuron Training in Cupertino seeks a Sr. Software Engineer to lead distributed training efforts for Trainium accelerators.

You will work across PyTorch and JAX to enable large-scale training, post-training, and RL workflows, owning parallelism strategies and driving performance improvements with compiler, runtime, and framework teams. Ideal candidates bring 5+ years of software leadership, deep ML experience, and a strong background in distributed systems.