AI Training Systems Engineer – Collective Compute

Amazon; Cupertino (CA); On-site; USD 165,000 - 224,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Job summary

Amazon’s Neuron Collectives team seeks a Software Developer to advance collective algorithms and topologies for AI training. You will optimize software-hardware co-design with Trainium silicon, verify bottlenecks using Neuron Explorer, and drive scalable collective operations across data centers.

You’ll collaborate with Annapurna Labs and infrastructure teams, building robust analysis frameworks and improving performance for large-scale ML workloads.

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems.
• Experience programming with at least one software programming language.

Responsibilities

• Enhance collective algorithms and topologies for optimal training performance.
• Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization.
• Monitor and analyze processor, DMA, firmware, and workload metrics.
• Optimize collective operations to scale AI compute across the data center through low level device driver development.
• Work closely with the hardware team to co-optimize software and Trainium silicon.
• Develop and optimize C/C++ implementations of collective communication patterns.
• Investigate and implement improvements for specific training topologies used by modern LLMs.
• Build and maintain analysis frameworks and automation solutions.

Skills

Software development

Architecture design

Programming languages

Education

Bachelor's degree in CS or equivalent

Tools

C/C++

Job description

Amazon’s Neuron Collectives team seeks a Software Developer to advance collective algorithms and topologies for AI training. You will optimize software-hardware co-design with Trainium silicon, verify bottlenecks using Neuron Explorer, and drive scalable collective operations across data centers.

You’ll collaborate with Annapurna Labs and infrastructure teams, building robust analysis frameworks and improving performance for large-scale ML workloads.