Senior ML Kernel Performance Architect

Amazon Web Services (AWS); Toronto; On-site; CAD 151,000 - 252,000; Full time

Job summary

Amazon Development Centre Canada ULC in Toronto is seeking a highly skilled software engineer to design and optimize ML compute kernels for Neuron, Amazon's ML accelerators. You will work at the HW/SW boundary to push kernel performance, collaborating with ML frameworks and customer teams.

The role emphasizes performance analysis, compiler optimizations, and mentoring junior engineers in a fast‑moving, startup‑like environment.

Qualifications

• 5+ years of professional software development experience
• Experience mentoring, tech lead, or team leadership
• Bachelor’s degree in computer science or equivalent

Responsibilities

• Design and implement high‑performance compute kernels for ML operations
• Analyze and optimize kernel performance across Neuron hardware generations
• Conduct detailed performance profiling to identify bottlenecks
• Implement compiler optimizations such as fusion, tiling, and scheduling
• Collaborate with customers to enable and optimize ML models on AWS accelerators

Skills

5+ years software dev

5+ years programming

5+ years design/architecture

Mentor / tech lead

Education

Bachelor's degree in CS or equivalent

Tools

CUDA

OpenCL

LLVM/MLIR

GPU ISA familiarity

Job description

Amazon Development Centre Canada ULC in Toronto is seeking a highly skilled software engineer to design and optimize ML compute kernels for Neuron, Amazon's ML accelerators. You will work at the HW/SW boundary to push kernel performance, collaborating with ML frameworks and customer teams.

The role emphasizes performance analysis, compiler optimizations, and mentoring junior engineers in a fast‑moving, startup‑like environment.