Senior AI/ML Software Engineer — Distributed Training

Amazon Web Services (AWS)

Seattle (WA)

On-site

USD 168,100 - 227,400

Full time

4 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

RSUs

Health benefits

Sign-on payments

Job summary

Annapurna Labs (U.S.) Inc. in Seattle, WA is seeking a software engineer for the AWS Neuron distributed training team. You will optimize training throughput for multi-model workloads and work with PyTorch, JAX, and the Neuron stack on Trainium instances to push efficiency.

The role partners with chip architects and runtime engineers to resolve bottlenecks and accelerate large-scale model training. A strong emphasis on code reviews and mentorship is expected.

Qualifications

5+ years of non-internship professional software development experience.
5+ years of programming with at least one software programming language.
5+ years of leading design or architecture of new and existing systems.
5+ years of full software development lifecycle, including reviews, source control, builds and testing.
Experience as a mentor, tech lead or leading an engineering team.

Responsibilities

Lead efforts to optimize distributed training performance on Trainium.
Focus on maximizing training throughput and model utilization across the Neuron stack.
Collaborate across PyTorch, JAX, and the Neuron compiler and runtime.
Identify and resolve bottlenecks across the stack from memory to kernel performance.

Skills

Software development

Distributed training

Mentorship

Performance optimization

Education

Bachelor's degree in computer science

Job description

The role partners with chip architects and runtime engineers to resolve bottlenecks and accelerate large-scale model training. A strong emphasis on code reviews and mentorship is expected.

Get your free, confidential resume review.

or drag and drop your file here.