ML Kernel Performance Engineer for Neuron

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 165,000 - 224,000; Full time

Job summary

Annapurna Labs (U.S.) Inc. in Cupertino, CA is hiring a software engineer to design high-performance compute kernels for AWS Neuron and related ML acceleration workloads.

You will optimize kernel performance across multiple Neuron generations, implement compiler optimizations, and work closely with customers to enable and tune models on AWS accelerators. Join a startup-like team within AWS, collaborating across frameworks, compilers, and runtime layers to push the boundaries of AI acceleration.

Qualifications

• 3+ years of professional software development experience required.
• Experience in design patterns, reliability and scaling of large systems.
• Strong programming skills in at least one software language.

Responsibilities

• Design and implement high-performance compute kernels for ML operations on Neuron architecture.
• Analyze and optimize kernel-level performance across Neuron generations.
• Conduct detailed performance profiling to identify bottlenecks and improvements.
• Implement compiler optimizations such as fusion, tiling, and scheduling.
• Collaborate with customers to enable and optimize ML models on AWS accelerators.
• Work across teams to develop innovative kernel optimization techniques.

Skills

Software development

System design

Programming languages

Education

Bachelor's degree in CS

Job description

Annapurna Labs (U.S.) Inc. in Cupertino, CA is hiring a software engineer to design high-performance compute kernels for AWS Neuron and related ML acceleration workloads.

You will optimize kernel performance across multiple Neuron generations, implement compiler optimizations, and work closely with customers to enable and tune models on AWS accelerators. Join a startup-like team within AWS, collaborating across frameworks, compilers, and runtime layers to push the boundaries of AI acceleration.