ML Compiler Team Lead for Custom AI Hardware

Amazon; Cupertino (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Amazon Annapurna Labs seeks a Software Engineering Manager to lead the Deep Learning Compiler Team in Cupertino, Seattle, or Austin. You will direct senior compiler engineers, drive optimization algorithms, and partner with AWS ML services to deploy on CPU, NPU, GPU, and custom AI hardware.

You will shape feature roadmaps, promote best practices in code generation and graph optimization, and help bring new compiler technologies to market within AWS ML initiatives.

Qualifications

• 5+ years of engineering team management experience.
• 9+ years of direct engineering experience.
• 4+ years of designing or architecting scalable systems and reliability solutions.
• Experience partnering with product or program management.
• Deep understanding of compilers, including resource management, instruction scheduling, code generation, and compute-graph optimization.
• Strong software design fundamentals and system-level coding skills with emphasis on graph theory and performance techniques.

Responsibilities

• Lead, mentor, and grow a team of compiler engineers.
• Own the design and implementation of compiler optimization algorithms for neural network workloads on CPU, NPU, GPU, and custom AI hardware.
• Collaborate with hardware and software partners to integrate new instruction sets and scheduling strategies.
• Engage with product and program management to shape feature roadmaps and define scope.
• Champion best practices in resource management, scheduling, code generation, and graph optimization.
• Drive high-quality, maintainable code through rigorous design reviews and testing.
• Represent the team at cross-functional meetings and contribute to the broader AWS ML ecosystem.

Skills

Engineering management

Compiler design

Performance optimization

Graph theory

System-level coding

Resource management

Education

PhD or MS in CS/CE

Tools

XLA

TVM

MLIR

LLVM

Job description

Amazon Annapurna Labs seeks a Software Engineering Manager to lead the Deep Learning Compiler Team in Cupertino, Seattle, or Austin. You will direct senior compiler engineers, drive optimization algorithms, and partner with AWS ML services to deploy on CPU, NPU, GPU, and custom AI hardware.

You will shape feature roadmaps, promote best practices in code generation and graph optimization, and help bring new compiler technologies to market within AWS ML initiatives.