Lead ML Systems Engineer – AI/GenAI Acceleration

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 193,000 - 262,000; Full time

Benefits offered by this job

Health insurance

RSUs (restricted stock units)

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Web Services (AWS) Annapurna Labs seeks a technical leader to build and optimize distributed training solutions for Trainium accelerators, integrating with PyTorch and JAX. You will own parallelism strategies and work across compiler, runtime, and frameworks to push frontier-scale models.

Join a team that values innovation in ML acceleration, high-performance computing, and scalable systems design. The role emphasizes collaboration, mentoring, and delivering measurable performance

Qualifications

• 5+ years of professional software development experience (non-internship).
• Strong programming experience in at least one language.
• 5+ years in design/architecture of scalable systems.
• Experience as a tech lead or engineering mentor.
• Bachelor's degree or higher in CS or equivalent.
• Familiarity with LLMs, transformers, and parallelism concepts.
• Experience in ML, data mining, NLP or related fields.

Responsibilities

• Lead distributed training and post-training support for Trainium integrations with PyTorch and JAX.
• Collaborate with Neuron compiler/runtime teams to optimize large-scale workloads.
• Own parallelism strategies (data, tensor, pipeline, expert) and apply reduced-precision formats.
• Profile workloads end-to-end to identify bottlenecks and drive fixes with cross-team engineers.

Skills

5+ years of non-internship software

5+ years programming in at least one语言

5+ years leading design/architecture

Mentor / tech lead experience

LLM/transformer fundamentals

ML/NLP/data mining experience

Education

Bachelor's degree or above in computer science

Master's degree or above in computer science

Tools

Pytorch/Jax

Distributed libraries/frameworks

RL frameworks / End-to-end model training

Performance profiling/optimization

Open source contributions

Job description

Amazon Web Services (AWS) Annapurna Labs seeks a technical leader to build and optimize distributed training solutions for Trainium accelerators, integrating with PyTorch and JAX. You will own parallelism strategies and work across compiler, runtime, and frameworks to push frontier-scale models.

Join a team that values innovation in ML acceleration, high-performance computing, and scalable systems design. The role emphasizes collaboration, mentoring, and delivering measurable performance