ML Kernel Performance Engineer, AI Accelerator

Amazon Inc.; Toronto; On-site; CAD 115,000 - 192,000; Full time

Benefits offered by this job

Health insurance

RRSP/retirement plan

Paid time off

Job summary

Amazon Web Services (AWS) Annapurna Labs seeks a ML Kernel Performance Engineer for AWS Neuron, to push high-performance kernel development for Inferentia and Trainium. You will design and optimize kernels, collaborate across compiler, runtime, framework, and hardware teams, and work directly with customers to maximize ML workloads on AWS accelerators, shaping the future of AI acceleration technology.

Join a small, agile team within a larger organization, enjoy a learning culture, publish

Qualifications

• 3+ years of non‑internship professional software development experience.
• 2+ years of design or architecture experience (design patterns, reliability and scaling).
• Experience programming with at least one software programming language.

Responsibilities

• Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
• Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
• Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
• Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
• Work directly with customers to enable and optimize their ML models on AWS accelerators
• Collaborate across teams to develop innovative kernel optimization techniques

Skills

Software development

System architecture

Programming languages

Education

Bachelor's degree in computer science or equivalent

Job description

Amazon Web Services (AWS) Annapurna Labs seeks a ML Kernel Performance Engineer for AWS Neuron, to push high-performance kernel development for Inferentia and Trainium. You will design and optimize kernels, collaborate across compiler, runtime, framework, and hardware teams, and work directly with customers to maximize ML workloads on AWS accelerators, shaping the future of AI acceleration technology.

Join a small, agile team within a larger organization, enjoy a learning culture, publish