ML Compiler Engineer for Neuron Accelerator

Annapurna Labs (U.S.) Inc.

Cupertino (CA)

On-site

USD 190,000 - 270,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Amazon's AWS Neuron compiler team seeks a software engineer to build the next generation Neuron compiler transforming ML models from PyTorch, TensorFlow, and JAX for AWS Inferentia and Trainium servers. You'll design and ship compiler passes, collaborate with chip architects and ML teams, and contribute to open-source projects like StableHLO, OpenXLA, and MLIR to optimize performance.

This role also offers exposure to pre-silicon design and scope to impact products at scale.

Qualifications

  • Experience in object-oriented languages (C++/Java) required.
  • Experience with compilers or building ML models using ML frameworks on accelerators preferred.
  • Familiarity with OpenXLA, StableHLO, MLIR is a plus.

Responsibilities

  • Design, implement, test, deploy and maintain compiler improvements for performance and usability.
  • Collaborate with chip architects, runtime/OS engineers, and ML teams to run models on AWS accelerators.
  • Experiment with open-source MLIR/OpenXLA/StableHLO to optimize workloads.
  • Develop features to improve user experiences for developers worldwide.
  • Participate in design discussions, code reviews, and communicate with internal and external stakeholders.

Skills

C++
Java
Compiler
ML frameworks
OpenXLA
StableHLO
MLIR
GPU accelerators

Job description

Amazon's AWS Neuron compiler team seeks a software engineer to build the next generation Neuron compiler transforming ML models from PyTorch, TensorFlow, and JAX for AWS Inferentia and Trainium servers. You'll design and ship compiler passes, collaborate with chip architects and ML teams, and contribute to open-source projects like StableHLO, OpenXLA, and MLIR to optimize performance.

This role also offers exposure to pre-silicon design and scope to impact products at scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Compiler Engineer — Neuron SDK
Senior ML Compiler Engineer — Neuron SDK

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 180,000 - 240,000
ML Compiler Engineer for AI Accelerators
ML Compiler Engineer for AI Accelerators

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 165,000 - 224,000
Senior ML Compiler Engineer — Flexible, High-Impact AI
Senior ML Compiler Engineer — Flexible, High-Impact AI

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 180,000 - 250,000
ML Compiler Engineer for Custom ML Accelerators
ML Compiler Engineer for Custom ML Accelerators

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 180,000 - 240,000
Sr ML Compiler Engineer for Cloud AI Acceleration
Sr ML Compiler Engineer for Cloud AI Acceleration

Amazon Web Services • Cupertino (CA)

On-site
USD 193,000 - 262,000
ML Compiler Engineer — Build Next‑Gen DL Stack
ML Compiler Engineer — Build Next‑Gen DL Stack

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 150,000 - 210,000
Machine Learning - Compiler Engineer , AWS Neuron, Annapurna Labs
Machine Learning - Compiler Engineer , AWS Neuron, Annapurna Labs

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 190,000 - 270,000
Senior ML Compiler Engineer — Optimize Models for Accelerators
Senior ML Compiler Engineer — Optimize Models for Accelerators

Annapurna Labs • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
RSUs / Stock options
Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs
Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 180,000 - 250,000
Senior ML Compiler Engineer – Neuron
Senior ML Compiler Engineer – Neuron

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000