AI Training Compute Software Engineer

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 165,000 - 224,000; Full time

Job summary

Annapurna Labs, part of AWS, seeks a Neuron Collectives Software Developer to optimize collective operations for Trainium. You will implement high-performance C/C++ code and work with hardware and firmware teams to maximize compute and interconnect bandwidth across data-center topologies.

You'll analyze algorithms with Neuron Explorer, identify bottlenecks, and contribute to scalable training topologies used by modern LLMs.

Qualifications

• Experience building complex software systems that have been successfully delivered to customers.
• Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
• Bachelor's degree in computer science or equivalent
• Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
• Experience in development in the last 3 years, or experience in embedded development in C/C++

Responsibilities

• Enhance collective algorithms and topologies for optimal training performance
• Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization
• Monitor and analyze processor, DMA, firmware, and workload metrics
• Optimize collective operations to scale AI compute across the data center
• Work closely with the hardware team to co-optimize software and Trainium silicon
• Develop and optimize C/C++ implementations of collective communication patterns
• Investigate and implement improvements for specific training topologies used by modern LLMs
• Build and maintain analysis frameworks and automation solutions

Skills

Complex software systems

Architecture & design

C/C++ embedded development

Code reviews & source control

Education

Bachelor's degree in computer science or equivalent

Master's degree in computer science or equivalent

Tools

Neuron Explorer

Job description

Annapurna Labs, part of AWS, seeks a Neuron Collectives Software Developer to optimize collective operations for Trainium. You will implement high-performance C/C++ code and work with hardware and firmware teams to maximize compute and interconnect bandwidth across data-center topologies.

You'll analyze algorithms with Neuron Explorer, identify bottlenecks, and contribute to scalable training topologies used by modern LLMs.