Senior ML Kernel Optimizer for AWS Neuron

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 193,000 - 262,000; Full time

Job summary

Annapurna Labs (U.S.) Inc. seeks experienced kernel engineers to optimize ML workloads on AWS accelerators. You will design high-performance compute kernels for ML ops and work across compiler, runtime, framework, and hardware teams to maximize Neuron-based performance.

The role emphasizes low-level optimization, system architecture, and collaboration with customers to enable model acceleration on Inferentia and Trainium. Cupertino, CA-based team location with a strong learning culture.

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of programming with at least one software programming language experience.
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience.
• Experience as a mentor, tech lead or leading an engineering team.

Responsibilities

• Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
• Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
• Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
• Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
• Work directly with customers to enable and optimize their ML models on AWS accelerators
• Collaborate across teams to develop innovative kernel optimization techniques

Skills

Software development

Programming languages

Leadership

Mentor / tech lead

SDLC / CI/CD

GPU kernel optimization

Education

Bachelor's degree in computer science or equivalent

Tools

CUDA

NVIDIA PTX

LLVM/MLIR

Job description

Annapurna Labs (U.S.) Inc. seeks experienced kernel engineers to optimize ML workloads on AWS accelerators. You will design high-performance compute kernels for ML ops and work across compiler, runtime, framework, and hardware teams to maximize Neuron-based performance.

The role emphasizes low-level optimization, system architecture, and collaboration with customers to enable model acceleration on Inferentia and Trainium. Cupertino, CA-based team location with a strong learning culture.