Senior ML Compiler Engineer — Neuron SDK

Annapurna Labs (U.S.) Inc.

Cupertino (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Amazon Web Services, Inc. is seeking a senior software engineer for the Neuron compiler team.

You will design and implement compiler improvements to optimize performance and stability for ML models on AWS Inferentia and Trainium, collaborating with chip architects and ML teams across the company. You will work with open-source communities like StableHLO, OpenXLA, and MLIR, contributing to pre-silicon design and feature delivery while ensuring the best cost/performance outcomes for customers

Qualifications

  • Experience in OO languages such as C++/Java is a must.
  • Experience with compilers or ML models on accelerators is preferred.
  • Familiar with OpenXLA, StableHLO, MLIR is a bonus.

Responsibilities

  • Design, implement, test, deploy and maintain Neuron compiler improvements for performance and stability.
  • Collaborate with chip architects, runtime/OS engineers, ML Apps teams to deploy models on AWS accelerators.
  • Engage with open-source communities (StableHLO, OpenXLA, MLIR) to influence optimization.
  • Develop features to deliver the best possible experiences for developers.

Skills

C++
Java

Tools

StableHLO
OpenXLA
MLIR

Job description

Amazon Web Services, Inc. is seeking a senior software engineer for the Neuron compiler team.

You will design and implement compiler improvements to optimize performance and stability for ML models on AWS Inferentia and Trainium, collaborating with chip architects and ML teams across the company. You will work with open-source communities like StableHLO, OpenXLA, and MLIR, contributing to pre-silicon design and feature delivery while ensuring the best cost/performance outcomes for customers

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr ML Compiler Engineer for Cloud AI Acceleration
Sr ML Compiler Engineer for Cloud AI Acceleration

Amazon Web Services • Cupertino (CA)

On-site
USD 193,000 - 262,000
Senior ML Compiler Engineer — Flexible, High-Impact AI
Senior ML Compiler Engineer — Flexible, High-Impact AI

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 180,000 - 250,000
ML Compiler Engineer for Neuron Accelerator
ML Compiler Engineer for Neuron Accelerator

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 190,000 - 270,000
Senior ML Compiler Engineer – Neuron
Senior ML Compiler Engineer – Neuron

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 168,000 - 227,000
Senior ML Compiler Engineer — Optimize Models for Accelerators
Senior ML Compiler Engineer — Optimize Models for Accelerators

Annapurna Labs • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
401(k) matching
RSUs / Stock options
ML Compiler Engineer for AI Accelerators
ML Compiler Engineer for AI Accelerators

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 165,000 - 224,000
ML Compiler Engineer — Build Next‑Gen DL Stack
ML Compiler Engineer — Build Next‑Gen DL Stack

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 150,000 - 210,000
Machine Learning - Compiler Engineer , AWS Neuron, Annapurna Labs
Machine Learning - Compiler Engineer , AWS Neuron, Annapurna Labs

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 190,000 - 270,000
Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs
Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 180,000 - 250,000
Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs
Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Annapurna Labs (U.S.) Inc. • Cupertino (CA)

On-site
USD 180,000 - 240,000