Senior ML Compiler Engineer – Neuron

Amazon Web Services (AWS); Seattle (WA); On-site; USD 168,000 - 227,000; Full time

Job summary

Annapurna Labs (U.S.) Inc. in Seattle is seeking a senior software engineer for the Neuron compiler team.

You will design, implement, test, deploy and maintain software that enhances compiler performance, stability and user interfaces for ML workloads run on AWS Inferentia and Trainium accelerators. You will collaborate with chip architects and ML scientists to optimize models from PyTorch, TensorFlow and JAX for cost-efficient deployment, and you will engage with open-source communities to

Qualifications

• Bachelor's degree in computer science or equivalent.
• 5+ years of full software development life cycle experience.
• 3+ years of experience in developing compiler features and optimizations.
• Proficiency with C++ and/or Python.

Responsibilities

• Design, implement, test, deploy and maintain innovative software to transform Neuron compiler performance and stability.
• Collaborate with chip architects, runtime/OS engineers, scientists and ML Apps teams to deploy ML models on AWS accelerators.
• Engage with open-source communities (StableHLO, OpenXLA, MLIR) to influence compiler optimizations.
• Contribute to a startup-like development environment with a focus on impactful work.

Skills

C++

Python

Education

Bachelor's degree in computer science or equivalent

Master or PhD in computer science or equivalent

Tools

LLVM

MLIR

Job description

Annapurna Labs (U.S.) Inc. in Seattle is seeking a senior software engineer for the Neuron compiler team.

You will design, implement, test, deploy and maintain software that enhances compiler performance, stability and user interfaces for ML workloads run on AWS Inferentia and Trainium accelerators. You will collaborate with chip architects and ML scientists to optimize models from PyTorch, TensorFlow and JAX for cost-efficient deployment, and you will engage with open-source communities to