ML Compiler Engineer for Custom AI Accelerators

Amazon; Seattle (WA); On-site; USD 143,700 - 194,400; Full time

Job summary

Amazon in Seattle is seeking ML compiler engineers to help build a state-of-the-art deep learning compiler stack that optimizes models across LLMs and vision workloads, interfacing with frameworks like PyTorch, TensorFlow and JAX. You will design, develop, and optimize compiler features while collaborating with Runtime, Frameworks, and Hardware teams to ensure system-wide performance.

As part of the Backend team, you’ll tackle challenges in code generation, instruction scheduling, memory

Qualifications

• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field.
• 3+ years of non‑internship professional software development experience.
• Proficiency with 1 or more programming languages (C++ preferred).
• 2+ years of experience in optimization algorithms, graph‑theory, hardware bring‑up, FPGA placement and routing algorithms, or hardware resource management.
• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience.
• MS or Ph.D. in computer science or related field.
• Strong knowledge in compiler design, instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programming, code generation, instruction set architectures, new hardware bring‑up, and hardware‑software co‑design.
• Experience with LLVM and/or MLIR.
• Experience with developing algorithms for simulation tools.
• Experience with TensorFlow, PyTorch, and/or JAX.
• Experience in LLM, Vision or other deep‑learning models.

Responsibilities

• Solve challenging technical problems, often ones not solved before, at every layer of the stack.
• Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security.
• Research implementations that deliver the best possible experiences for customers.

Skills

C++

Compiler design

Optimization algorithms

Graph theory

Parallel programming

Code generation

Education

MS/PhD in CS or related field

Bachelor's degree in CS or related field

Tools

LLVM/MLIR

TensorFlow

PyTorch

JAX

FPGA placement

Job description

Amazon in Seattle is seeking ML compiler engineers to help build a state-of-the-art deep learning compiler stack that optimizes models across LLMs and vision workloads, interfacing with frameworks like PyTorch, TensorFlow and JAX. You will design, develop, and optimize compiler features while collaborating with Runtime, Frameworks, and Hardware teams to ensure system-wide performance.

As part of the Backend team, you’ll tackle challenges in code generation, instruction scheduling, memory