ML Compiler Engineer for AI Inference on Accelerators

Annapurna Labs (U.S.) Inc.; Cupertino (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Annapurna Labs (U.S.) Inc. is seeking a software engineer for the AWS Neuron Compiler team. You will build and optimize a compiler that translates ML models from frameworks like PyTorch, TensorFlow, and JAX to run efficiently on AWS Inferentia and Trainium.

You will work with accelerators and contribute to pre-silicon design while collaborating with internal and external stakeholders. You should have strong experience in C++/Java, compiler development, and ML frameworks, with familiarity with

Qualifications

• Experience with object-oriented languages (C++/Java) is required.
• Experience with compilers or ML models on accelerators is preferred.
• Familiarity with ML frameworks (PyTorch, TensorFlow, JAX) is relevant.
• Knowledge of OpenXLA, StableHLO, MLIR is a plus.

Responsibilities

• Build next-generation Neuron compiler transforming ML models to AWS Inferentia/Trainium targets.
• Solve compiler optimization problems to maximize performance for large model families.
• Collaborate with customers/stakeholders to gather requirements and communicate tradeoffs.
• Participate in pre-silicon design and bring new features to market.
• Design and implement compiler passes and verification for accelerator tech.

Skills

C++

Java

Compiler design

ML frameworks

Tools

OpenXLA

StableHLO

MLIR

Job description

Annapurna Labs (U.S.) Inc. is seeking a software engineer for the AWS Neuron Compiler team. You will build and optimize a compiler that translates ML models from frameworks like PyTorch, TensorFlow, and JAX to run efficiently on AWS Inferentia and Trainium.

You will work with accelerators and contribute to pre-silicon design while collaborating with internal and external stakeholders. You should have strong experience in C++/Java, compiler development, and ML frameworks, with familiarity with