Senior Software Engineer - AI Training Collectives

Amazon Inc.; Cupertino (CA); Hybrid; USD 193,000 - 262,000; Full time

Benefits offered by this job

RSUs

Sign-on payments

Health insurance

Job summary

Annapurna Labs, part of AWS, seeks a Sr Software Development Engineer to optimize collective operations for Trainium. You will develop and refine C/C++ implementations, align software with hardware, and push performance across data-center scale.

You will analyze training topologies, collaborate with hardware, and advance software that powers large-scale AI model training. This role emphasizes deep systems expertise and scalable design.

Qualifications

• Bachelor's degree in computer science or equivalent.
• 5+ years of experience building complex software systems delivered to customers.
• 5+ years of experience contributing to architecture and design of new and current systems.
• Master's degree in computer science or equivalent.
• Familiarity with collective communication algorithms (e.g., all-reduce, all-gather) or distributed training frameworks.

Responsibilities

• Enhance collective algorithms and topologies for optimal training performance.
• Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization.
• Monitor and analyze processor, DMA, firmware, and workload metrics.
• Optimize collective operations to scale AI compute across the data center.
• Work closely with the hardware team to co-optimize software and Trainium silicon.
• Develop and optimize C/C++ implementations of collective communication patterns.
• Investigate and implement improvements for specific training topologies used by modern LLMs.
• Build and maintain analysis frameworks and automation solutions.

Skills

Complex software

Software architecture

Distributed training

Education

Bachelor's degree in CS or equivalent

Master's degree in CS or equivalent

Job description

Annapurna Labs, part of AWS, seeks a Sr Software Development Engineer to optimize collective operations for Trainium. You will develop and refine C/C++ implementations, align software with hardware, and push performance across data-center scale.

You will analyze training topologies, collaborate with hardware, and advance software that powers large-scale AI model training. This role emphasizes deep systems expertise and scalable design.