Sr. Machine Learning - Compiler Engineer Iii, Aws Neuron, Annapurna Labs

Amazon; Cupertino (CA); On-site; USD 193,300 - 261,500; Full time

Benefits offered by this job

Health benefits

401(k) matching

Parental leave

Job summary

Amazon's AWS Neuron team in Cupertino, CA seeks a senior software engineer to advance the next generation of a compiler transforming PyTorch, TensorFlow and JAX models into efficient deployments on Inferentia and Trainium servers.

As part of a startup‑like environment within AWS, you will design and implement optimization passes, collaborate across chip, runtime, and ML teams, and contribute to open‑source communities while mentoring others. Expect rigorous code reviews and robust testing.

Qualifications

• Bachelor's degree in computer science or equivalent.
• 5+ years of full software development life cycle experience.
• 3+ years of experience developing compiler features and optimizations.
• Proficiency in C++ or Python.

Responsibilities

• Design, implement, test, deploy, and maintain software for Neuron compiler performance, stability, and UI.
• Collaborate with chip architects, runtime/OS engineers, scientists, and ML teams on deployment of ML models.
• Represent the Neuron compiler in open-source communities (StableHLO, OpenXLA, MLIR) and engage with industry partners.
• Create compiler optimization and verification passes and tools for numerical error analysis.
• Resolve defects, participate in design reviews, and communicate with stakeholders via GitHub.
• Operate in a startup-like environment focused on critical development work.

Skills

Compiler development

C++

Python

Education

Bachelor's degree in Computer Science or equivalent

Tools

LLVM/MLIR

Job description

Overview

Do you want to be part of the AI revolution? At AWS we create innovative software and hardware solutions that make deep learning pervasive for everyday developers. AWS Neuron is an SDK that optimizes the performance of complex ML models on AWS Inferentia and Trainium, custom chips designed to accelerate deep‑learning workloads. This role is for a senior software engineer in the Compiler team responsible for building the next‑generation Neuron compiler, which transforms ML models written in frameworks such as PyTorch, TensorFlow, and JAX into efficient deployments on AWS Inferentia and Trainium servers.

Key Responsibilities

• Design, implement, test, deploy, and maintain software solutions to improve Neuron compiler performance, stability, and user interface.
• Collaborate with chip architects, runtime/OS engineers, scientists, and ML app teams to deploy cutting‑edge ML models on AWS accelerators with optimal cost/performance.
• Serve as the front‑face of the Neuron compiler in open‑source communities (e.g., StableHLO, OpenXLA, MLIR) and influence industry partners.
• Create compiler optimization and verification passes, build features that expose AWS accelerator capabilities to developers, and implement tools for numerical error analysis.
• Resolve compiler defects, participate in design discussions, conduct code reviews, and communicate with internal and external stakeholders through forums such as GitHub.
• Work in a startup‑like environment focused on the most important development work.

About the Team

Our team supports new members and values knowledge sharing, mentorship, and career growth. Senior members provide one‑on‑one mentorship and thorough, yet kind, code reviews, empowering engineers to take on increasingly complex tasks.

Basic Qualifications

• Bachelor's degree in computer science or equivalent.
• 5+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.
• 3+ years of experience developing compiler features and optimizations.
• Proficiency in at least one of the following languages: C++ (preferred), Python.

Preferred Qualifications

• Master's or Ph.D. in computer science or equivalent.
• Deep knowledge of compiler design, resource management, instruction scheduling, memory allocation, data transfer optimization, compute graph optimization, code generation, and instruction‑set architecture.
• Experience with LLVM and/or MLIR.
• Experience with large‑language models, vision models, or other deep‑learning models.

Benefits

Amazon offers a comprehensive benefits package including health, dental, vision, prescription, Basic Life & AD&D, supplemental life plans, EAP, mental health support, medical advice line, flexible spending accounts, adoption and surrogacy reimbursement, 401(k) matching, paid time off, and parental leave.

Location and Compensation

Cupertino, CA – Salary range: $193,300.00–$261,500.00 USD annually. Compensation includes sign‑on payments and restricted stock units (RSUs).

Equal Opportunity Employer

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Posted: July 16, 2026