Senior ML Compiler Engineer — Optimize Models for Accelerators

Annapurna Labs; Cupertino (CA); On-site; USD 193,000 - 262,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

RSUs / Stock options

Job summary

Annapurna Labs (U.S.) Inc. in Cupertino, CA is seeking a senior software engineer to join the AWS Neuron compiler team.

You will help build the next‑generation compiler that transforms ML models from frameworks like PyTorch, TensorFlow, and JAX into optimized code for AWS Inferentia and Trainium servers in the cloud. You will tackle hard compiler optimization problems, understand model internals, and work with OpenXLA, StableHLO, and MLIR.

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of programming with at least one software programming language experience.
• Experience as a mentor, tech lead or leading an engineering team.

Responsibilities

• Design and implement compiler optimization and verification passes.
• Create features for AWS accelerators and expose engineer-friendly APIs.
• Collaborate with internal Neuron SDK and Amazon teams; engage with open-source communities.
• Assist in pre-silicon design and bring new products/features to market.

Education

Bachelor's degree in computer science or equivalent

Tools

OpenXLA

StableHLO

MLIR

Job description

Annapurna Labs (U.S.) Inc. in Cupertino, CA is seeking a senior software engineer to join the AWS Neuron compiler team.

You will help build the next‑generation compiler that transforms ML models from frameworks like PyTorch, TensorFlow, and JAX into optimized code for AWS Inferentia and Trainium servers in the cloud. You will tackle hard compiler optimization problems, understand model internals, and work with OpenXLA, StableHLO, and MLIR.