Machine Learning - Compiler Engineer II, AWS Neuron, Annapurna Labs

Overview

Job ID: 2933964 | Amazon Web Services, Inc. - A97

Do you want to be part of AI revolution? At AWS our vision is to make deep learning pervasive for everyday developers and to democratize access to AI hardware and software infrastructure. AWS Neuron is the SDK that optimizes the performance of complex ML models executed on AWS Inferentia and Trainium, our custom chips designed to accelerate deep-learning workloads.

This role is for a software engineer in the Compiler team for AWS Neuron. You will be responsible for building the next generation Neuron compiler which transforms ML models written in ML frameworks (e.g., PyTorch, TensorFlow, and JAX) to be deployed on AWS Inferentia and Trainium based servers in the Amazon cloud. You will solve compiler optimization problems to achieve optimum performance for a variety of ML model families including large language models and other workloads.

You will need to understand how these models work inside-out to guide the compiler in generating optimal implementations. You will partner with internal and external customers/stakeholders and will be involved in pre-silicon design, bringing new products/features to market, ultimately making the Neuron compiler highly performant and easy to use.

Experience in object-oriented languages like C++/Java is required. Experience with compilers or building ML models using ML frameworks on accelerators (e.g., GPUs) is preferred but not required. Experience with technologies like OpenXLA, StableHLO, and MLIR is a plus.

Explore the product and our history. See AWS Neuron documentation and related resources for more information.

AWS Utility Computing (UC) provides product innovations across Compute, Database, Storage, Internet of Things, Platform, and Productivity Apps, and supports customers with specialized security needs.

Key job responsibilities

A day in the life

About the team

Our team supports new members with mentorship and knowledge-sharing. We value career growth and assign projects to develop engineering expertise.

Diversity & Inclusion

AWS values diverse experiences. If you do not meet all qualifications, we encourage you to apply. We support accessibility and accommodation requests during the hiring process.

Qualifications

Basic qualifications

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture experience for new or existing systems
• Experience programming in at least one software language

Preferred qualifications

• Master’s degree or PhD in Computer Science or related field
• 3+ years of production-grade code in object-oriented languages such as C++/Java
• Experience in compiler design for CPU/GPU/Vector engines/ML accelerators
• Experience with OpenSource compiler toolsets like LLVM/MLIR
• Experience with PyTorch, OpenXLA, StableHLO, JAX, TVM, deep learning models and related algorithms
• Experience with modern build systems like Bazel or CMake

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: job duties include safety, cooperation, effective communication, and adherence to laws and company policies. Criminal history may be considered. We will consider qualified applicants with arrest or conviction records under applicable law.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you need a workplace accommodation during the application process, visit our accommodations page for more information.

Base pay ranges and compensation details are provided per location and market factors. This position will remain posted until filled. Applicants should apply via our internal or external career site.