Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna Labs

Amazon Web Services (AWS); Toronto; On-site; CAD 214,200 - 357,800; Full time

Job summary

Amazon in Toronto, Canada is seeking a senior engineering leader to head a compiler team building for AWS Inferentia and Trainium. You will guide architecture, scheduling, and optimization work across a global ML stack.

The role requires extensive experience in compiler design, leadership of cross‑functional teams, and collaboration with product managers to deliver enterprise‑scale solutions in a fast‑moving cloud environment.

Qualifications

• 6+ years of engineering team management experience.
• 8+ years of direct engineering work experience.
• 6+ years of designing or architecting new and existing systems (design patterns, reliability and scaling).
• Experience partnering with product or program management teams.
• Demonstrated software engineering skills through relevant experience (internships, work, competitions, publications) and strong analytical, attention‑to‑detail and effective communication skills.

Responsibilities

• Lead a team of compiler engineers in developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium.
• Leverage vision and technical communication skills as a hands‑on partner to AWS ML services teams, contributing to pre‑silicon design, new product releases, optimizations, and features that meet customer needs.
• Apply deep knowledge of resource management, scheduling, code generation, optimization and novel instruction architectures (CPU, NPU, GPU and emerging compute).
• Drive software architecture efficiencies, implement automation, resolve root causes of defects, and build high‑impact solutions for a large customer base.
• Participate in design discussions, code review, cross‑functional business decisions, and startup‑like development environment.

Skills

Engineering management

Team leadership

Compiler engineering

Code generation

AI acceleration

Education

MS/PhD in Computer Science

Tools

LLVM

GCC

Job description

Overview

The Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. The Inferentia chip delivers best‑in‑class ML inference performance at the lowest cost in the cloud. Trainium will deliver the best‑in‑class ML training performance with the most teraflops (TFLOPS) of compute power for ML in the cloud. This is enabled by a cutting‑edge software stack—the AWS Neuron Software Development Kit (SDK)—which includes an ML compiler, runtime and natively integrates into popular ML frameworks, such as PyTorch, TensorFlow and MxNet. The Neuron SDK optimizes performance of complex neural‑net models executed on AWS Inferentia and Trainium. AWS Neuron is used at scale with customers and partners like PyTorch, Epic Games, Snap, AirBnB, Autodesk, Amazon Alexa, Amazon Rekognition and other customers in various segments.

Responsibilities

• Lead a team of compiler engineers in developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium.
• Leverage vision and technical communication skills as a hands‑on partner to AWS ML services teams, contributing to pre‑silicon design, new product releases, optimizations, and features that meet customer needs.
• Apply deep knowledge of resource management, scheduling, code generation, optimization and novel instruction architectures (CPU, NPU, GPU and emerging compute).
• Drive software architecture efficiencies, implement automation, resolve root causes of defects, and build high‑impact solutions for a large customer base.
• Participate in design discussions, code review, cross‑functional business decisions, and startup‑like development environment.

A Day in the Life

• Design and code solutions that drive software architecture efficiencies.
• Create metrics, implement automation, and improve bugs/defects.
• Deliver high‑impact solutions to a large customer base.
• Participate in design discussions, code review, and communicate with stakeholders.
• Work cross‑functionally to influence business decisions with technical input.
• Operate in a startup‑like environment, tackling the most important projects.

Basic Qualifications

• 6+ years of engineering team management experience.
• 8+ years of direct engineering work experience.
• 6+ years of designing or architecting new and existing systems (design patterns, reliability and scaling).
• Experience partnering with product or program management teams.
• Demonstrated software engineering skills through relevant experience (internships, work, competitions, publications) and strong analytical, attention‑to‑detail and effective communication skills.

Preferred Qualifications

• M.S. or Ph.D. in Computer Science or related technical field.
• Experience with toolchains (LLVM, GCC) and code‑generation techniques for new hardware.
• Knowledge of compiler internals from front end to runtime with emphasis on AI acceleration.

Location

Toronto, Canada – candidates must be currently located or willing to relocate.

Compensation

Base salary range: 214,200.00 – 357,800.00 CAD annually.

Equal Opportunity Statement

Amazon is an equal‑opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information.