Software Development Manager – NKI Compiler for Neuron

Amazon; Cupertino (CA); On-site; USD 213,000 - 288,000; Full time

Benefits offered by this job

RSUs

Health insurance

401(k) matching

Job summary

Amazon is seeking a Software Development Manager for the NKI compiler on AWS Trainium at Annapurna Labs in Cupertino. You will lead a compiler team, directing feature delivery while aligning with product, kernel, runtime, and hardware partners to accelerate ML workloads.

The role requires technical credibility and a passion for people growth. You will shape the roadmap, mentor engineers, review designs, and stay close to code and hardware to unblock critical paths, delivering high-impact

Qualifications

• 2+ years of engineering team management experience.
• 6+ years of working directly within engineering teams experience.
• 4+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience.
• Experience partnering with product or program management teams.
• Understanding of compilers (resource management, instruction scheduling, code generation, and compute graph optimization).
• Strong software design fundamentals and excellent system-level coding skills.

Responsibilities

• Lead, grow, and mentor a team of compiler engineers, including hiring, career development, and team health
• Own execution and delivery of NKI compiler features across release cycles, balancing scope, quality, and timelines
• Set technical direction and roadmap for your area of the NKI compiler in partnership with senior engineers
• Partner across teams, including frameworks, kernel development, runtime, hardware/pre-silicon design, and product management, to bring new features to market
• Drive resolution of complex, high-priority technical issues, staying close enough to the code and hardware to guide the team
• Represent your team's work and priorities to senior leadership and cross-organizational stakeholders
• Anchor decisions in customer impact, ensuring the team builds what unblocks real ML workloads on Trainium

Skills

Engineering leadership

Team management

Resource scheduling

Compiler knowledge

System-level coding

Cross-functional collaboration

Education

MS/PhD in CS

Tools

PyTorch

JAX

Job description

Amazon is seeking a Software Development Manager for the NKI compiler on AWS Trainium at Annapurna Labs in Cupertino. You will lead a compiler team, directing feature delivery while aligning with product, kernel, runtime, and hardware partners to accelerate ML workloads.

The role requires technical credibility and a passion for people growth. You will shape the roadmap, mentor engineers, review designs, and stay close to code and hardware to unblock critical paths, delivering high-impact