ML Compiler Engineer, Annapurna Labs

Amazon; Seattle (WA); On-site; USD 143,700 - 194,400; Full time

Job summary

Amazon in Seattle is seeking ML compiler engineers to help build a state-of-the-art deep learning compiler stack that optimizes models across LLMs and vision workloads, interfacing with frameworks like PyTorch, TensorFlow and JAX. You will design, develop, and optimize compiler features while collaborating with Runtime, Frameworks, and Hardware teams to ensure system-wide performance.

As part of the Backend team, you’ll tackle challenges in code generation, instruction scheduling, memory

Qualifications

• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field.
• 3+ years of non‑internship professional software development experience.
• Proficiency with 1 or more programming languages (C++ preferred).
• 2+ years of experience in optimization algorithms, graph‑theory, hardware bring‑up, FPGA placement and routing algorithms, or hardware resource management.
• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience.
• MS or Ph.D. in computer science or related field.
• Strong knowledge in compiler design, instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programming, code generation, instruction set architectures, new hardware bring‑up, and hardware‑software co‑design.
• Experience with LLVM and/or MLIR.
• Experience with developing algorithms for simulation tools.
• Experience with TensorFlow, PyTorch, and/or JAX.
• Experience in LLM, Vision or other deep‑learning models.

Responsibilities

• Solve challenging technical problems, often ones not solved before, at every layer of the stack.
• Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security.
• Research implementations that deliver the best possible experiences for customers.

Skills

C++

Compiler design

Optimization algorithms

Graph theory

Parallel programming

Code generation

Education

MS/PhD in CS or related field

Bachelor's degree in CS or related field

Tools

LLVM/MLIR

TensorFlow

PyTorch

JAX

FPGA placement

Job description

The AWS Neuron Compiler team is actively seeking skilled compiler engineers to join our efforts in developing a state‑of‑the‑art deep learning compiler stack. This stack is designed to optimize application models across diverse domains, including Large Language and Vision, originating from leading frameworks such as PyTorch, TensorFlow, and JAX. Your role will involve working closely with our custom‑built Machine Learning accelerators, including Inferentia / Trainium, which represent the forefront of AWS innovation for advanced ML capabilities, powering solutions like Generative AI.

In this role as a ML Compiler engineer, you’ll be instrumental in designing, developing, and optimizing features for our compiler. Your responsibilities will involve tackling crucial challenges alongside a talented engineering team, contributing to leading‑edge design and research in compiler technology and deep‑learning systems software. Additionally, you’ll collaborate closely with cross‑functional team members from the Runtime, Frameworks, and Hardware teams to ensure system‑wide performance optimization.

As part of the Backend team, you’ll play a significant role in designing and developing various aspects of our system. This includes but is not limited to instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programming, code generation, instruction set architectures, new hardware bring‑up, and hardware‑software co‑design.

Key Job Responsibilities

• Solve challenging technical problems, often ones not solved before, at every layer of the stack.
• Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security.
• Research implementations that deliver the best possible experiences for customers.

A Day in the Life

• Build high‑impact solutions to deliver to our large customer base.
• Participate in design discussions, code review, and communicate with internal and external stakeholders.
• Work cross‑functionally to help drive business decisions with your technical input.
• Work in a startup‑like development environment, where you’re always working on the most important stuff.

Qualifications

• • Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field.
• • 3+ years of non‑internship professional software development experience.
• • Proficiency with 1 or more programming languages (C++ preferred).
• • 2+ years of experience in optimization algorithms, graph‑theory, hardware bring‑up, FPGA placement and routing algorithms, or hardware resource management.
• • 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience.
• • M.S. or Ph.D. in computer science or related field.
• • Strong knowledge in one or more of the areas of: compiler design, instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programming, code generation, instruction set architectures, new hardware bring‑up, and hardware‑software co‑design.
• • Experience with LLVM and/or MLIR.
• • Experience with developing algorithms for simulation tools.
• • Experience with TensorFlow, PyTorch, and/or JAX.
• • Experience in LLM, Vision or other deep‑learning models.

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits .

USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually