Sr Software Development Engineer, Neuron Collectives, Annapurna Labs

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Sign-on payments

Restricted stock units (RSUs)

Medical insurance

Dental insurance

Vision insurance

Prescription insurance

Basic Life & AD&D insurance

Supplemental life plans

EAP

Mental Health Support

Medical Advice Line

Flexible Spending Accounts

Adoption and Surrogacy Reimbursement覆盖

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Web Services (AWS) is seeking an experienced software engineer to optimize collective operations and communication patterns for Trainium, enabling scalable AI compute across data centers.

In collaboration with hardware teams, you will co-optimize software and silicon for modern LLM training topologies, focusing on performance, reliability, and efficiency.

Qualifications

• Bachelor's degree in Computer Science
• 5+ years of experience building complex software systems and architecture
• Familiarity with collective communication algorithms or distributed training frameworks is preferred

Responsibilities

• Optimize collective operations and communication patterns for AWS Trainium to scale AI compute across data centers.
• Collaborate with hardware teams to co‑optimize software and silicon for modern LLM training topologies.

Skills

C++

Collective comms

Distributed systems

DMA

Firmware

AI training

LLM topologies

Software architecture

Performance optimization

Neuron Explorer

Bus bandwidth

System design

Education

Bachelor's degree in Computer Science

Job description

Optimize collective operations and communication patterns for AWS Trainium to scale AI compute across data centers. Collaborate with hardware teams to co‑optimize software and silicon for modern LLM training topologies.

Requirements

Requires a Bachelor's degree in Computer Science and at least 5 years of experience in building complex software systems and architecture. Familiarity with collective communication algorithms or distributed training frameworks is preferred.

Key Skills

C++, Collective Communication Algorithms, Distributed Systems, DMA, Firmware, AI Training, LLM Topologies, Software Architecture, Performance Optimization, Neuron Explorer, Bus Bandwidth Optimization, System Design

Benefits

• Sign-on payments
• Restricted stock units (RSUs)
• Medical insurance
• Dental insurance
• Vision insurance
• Prescription insurance
• Basic Life & AD&D insurance
• Supplemental life plans
• EAP
• Mental Health Support
• Medical Advice Line
• Flexible Spending Accounts
• Adoption and Surrogacy Reimbursement coverage
• 401(k) matching
• Paid time off
• Parental leave