Senior ML Compiler Engineer for Neuron Accelerators

Amazon; Cupertino (CA); On-site; USD 193,000 - 262,000; Full time

Benefits offered by this job

Health insurance

RSUs and stock-based compensation

401(k) matching

Paid time off

Parental leave

Job summary

Amazon's Neuron team in Cupertino is seeking a Sr. ML Compiler Engineer to lead the ground-up development and scaling of a compiler for the world's largest ML workloads on Trainium. You will architect features, mentor engineers, and collaborate across teams with pre-silicon design responsibilities.

You will publish research, drive high-impact changes, and work closely with PyTorch/JAX teams, model teams, and hardware teams. Relocation to Cupertino is encouraged.

Qualifications

• 5+ years of non-internship professional software development experience.
• 5+ years of programming with at least one software programming language.
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• Experience as a mentor, tech lead or leading an engineering team.

Responsibilities

• Design and build compiler features for the Neuron compilers. Your work may span the frontend, intermediate representations, optimization passes, and code generation for the hardware.
• Own customer-critical features end to end: scope the problem, write the design, ship production code, and provide support to customers.
• Partner with Amazon ML teams (PyTorch, JAX, and internal model teams) as a hands-on technical contact. You translate their workloads into compiler requirements and unblock them on hardware.
• Contribute to pre-silicon design. You give the hardware teams compiler and programmability feedback before a chip is built, and you bring new products and features to customers.
• Raise the technical bar by reviewing code and designs, publishing research where it makes sense, and mentoring engineers.

Skills

Software development

Programming

Mentorship

Education

Master's degree

Ph.D.

Job description

Amazon's Neuron team in Cupertino is seeking a Sr. ML Compiler Engineer to lead the ground-up development and scaling of a compiler for the world's largest ML workloads on Trainium. You will architect features, mentor engineers, and collaborate across teams with pre-silicon design responsibilities.

You will publish research, drive high-impact changes, and work closely with PyTorch/JAX teams, model teams, and hardware teams. Relocation to Cupertino is encouraged.