Senior ML Kernel Performance Architect

Amazon; Cupertino (CA); On-site; USD 193,300 - 261,500; Full time

Job summary

Amazon is seeking a Sr. ML Kernel Performance Engineer for AWS Neuron at Annapurna Labs to design and optimize high‑performance kernels for ML operations on Neuron accelerators. You will collaborate with hardware, compiler, runtime, and framework teams to maximize throughput and efficiency.

Responsibilities include profiling, identifying bottlenecks, implementing fusion, tiling, and scheduling, and enabling customers to deploy optimized models on AWS accelerators.

Qualifications

• 5+ years of non‑internship professional software development experience.
• 5+ years of programming in at least one software programming language.
• 5+ years of leading design or architecture of new and existing systems (design patterns, reliability, scaling).
• 5+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.
• Experience as a mentor, tech lead, or leading an engineering team.
• Experience with GPU kernel optimization and GPGPU computing.

Responsibilities

• Design and implement high‑performance compute kernels for ML operations on Neuron hardware
• Analyze and optimize kernel‑level performance across multiple generations of Neuron accelerators
• Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
• Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
• Work directly with customers to enable and optimize their ML models on AWS accelerators
• Collaborate across teams to develop innovative kernel optimization techniques

Skills

5+ years software development

5+ years programming

5+ years design/architecture

5+ years SDLC experience

Mentor / tech lead

Parallel programming

Education

Bachelor’s degree in computer science or equivalent

Tools

CUDA

NVIDIA PTX

LLVM/MLIR

GPGPU backends

OpenCL

Triton

Job description

Amazon is seeking a Sr. ML Kernel Performance Engineer for AWS Neuron at Annapurna Labs to design and optimize high‑performance kernels for ML operations on Neuron accelerators. You will collaborate with hardware, compiler, runtime, and framework teams to maximize throughput and efficiency.

Responsibilities include profiling, identifying bottlenecks, implementing fusion, tiling, and scheduling, and enabling customers to deploy optimized models on AWS accelerators.