ML Compiler Engineer for AI Inference Accelerators

Amazon Inc.; Cupertino (CA); On-site; USD 165,000 - 224,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon is seeking a software engineer for the AWS Neuron Compiler team in Cupertino, CA. You will build the next‑generation Neuron compiler to translate ML models from PyTorch, TensorFlow, and JAX for deployment on AWS Inferentia/Trainium in the cloud.

You will work with OpenXLA, StableHLO and MLIR, design optimization passes, and collaborate with chip architects, runtime engineers, scientists, and ML apps teams to deliver high performance and a great developer experience.

Qualifications

• 3+ years of non‑internship software development experience.
• 2+ years of non‑internship design or architecture (design patterns, reliability and scaling) experience.
• Experience with at least one software programming language

Responsibilities

• Design, implement, test, deploy and maintain innovative software solutions to transform Neuron compiler’s performance, stability and user‑interface.
• Collaborate with chip architects, runtime/OS engineers, scientists and ML Apps teams to deploy ML models on AWS accelerators with cost/performance benefits.
• Work with open‑source software (StableHLO, OpenXLA, MLIR) to optimize ML workloads on AWS software/hardware.
• Build features delivering the best developer experience for customers across the globe.

Skills

Software development

OOP (C++/Java)

Compiler design

ML frameworks

OpenXLA/MLIR/StableHLO

Education

Master’s or PhD in CS

Tools

OpenXLA

StableHLO

MLIR

LLVM

PyTorch

Job description

Amazon is seeking a software engineer for the AWS Neuron Compiler team in Cupertino, CA. You will build the next‑generation Neuron compiler to translate ML models from PyTorch, TensorFlow, and JAX for deployment on AWS Inferentia/Trainium in the cloud.

You will work with OpenXLA, StableHLO and MLIR, design optimization passes, and collaborate with chip architects, runtime engineers, scientists, and ML apps teams to deliver high performance and a great developer experience.