Senior AI/ML Software Engineer - Neuron Optimizations

Annapurna Labs (U.S.) Inc.; Seattle (WA); On-site; USD 180,000 - 230,000; Full time

Job summary

Amazon's AWS Neuron team is seeking a Senior Software Engineer to optimize AI models on custom accelerators (Inferentia and Trainium). You will work across compiler, runtime, framework, and hardware teams to push performance at scale and drive innovations in ML acceleration.

You will design and implement high-performance kernels, transform tensor operations into optimized graph representations, and collaborate with customers to enable efficient model deployment on AWS hardware.

Qualifications

• Strong software development experience in Python and low-level programming for ML workloads.
• Experience optimizing ML models for high performance on specialized accelerators.
• Knowledge of distributed systems and performance profiling is beneficial.

Responsibilities

• Design, develop, and optimize ML models on AWS Neuron accelerators.
• Tune models for peak performance and efficiency on Inferentia and Trainium hardware.
• Collaborate across compiler, runtime, framework, and hardware teams to optimize workloads.
• Develop high-performance kernels and graph-level optimizations for ML ops.
• Work with customers to enable and optimize their models on AWS accelerators.

Skills

Python

System-level programming

ML knowledge

Performance tuning

Distributed systems

Tools

Profiling tools

Open-source ML frameworks

Job description

Amazon's AWS Neuron team is seeking a Senior Software Engineer to optimize AI models on custom accelerators (Inferentia and Trainium). You will work across compiler, runtime, framework, and hardware teams to push performance at scale and drive innovations in ML acceleration.

You will design and implement high-performance kernels, transform tensor operations into optimized graph representations, and collaborate with customers to enable efficient model deployment on AWS hardware.