Sr ML Compiler Engineer for Cloud AI Acceleration

Amazon Inc.; Cupertino (CA); On-site; USD 193,000 - 262,000; Full time

Job summary

Amazon Inc. seeks a senior software engineer to join the Neuron Compiler team.

You will design, implement, and optimize a compiler that translates ML models for AWS Inferentia/Trainium, collaborating with chip architects and ML teams to deploy efficient, scalable workloads in the cloud. You will engage with open-source communities and help bring new features to market while shaping the pre-silicon roadmap and exploring cost/performance optimizations for diverse model families like Llama, Stable

Qualifications

• 5+ years of professional software development experience.
• 5+ years of programming with at least one software programming language experience.
• Experience leading design or architecture of new and existing systems.

Responsibilities

• Design, implement, test, deploy and maintain innovative software solutions to transform Neuron compiler's performance.
• Collaborate with chip architects, runtime/OS engineers, scientists and ML Apps teams.
• Represent Neuron Compiler to open-source communities and influence industry partners.

Skills

5+ years professional software

Mentor / tech lead

C++/Java experience

Education

Bachelor's degree in Computer Science or equivalent

Tools

MLIR

OpenXLA

StableHLO

Job description

Amazon Inc. seeks a senior software engineer to join the Neuron Compiler team.

You will design, implement, and optimize a compiler that translates ML models for AWS Inferentia/Trainium, collaborating with chip architects and ML teams to deploy efficient, scalable workloads in the cloud. You will engage with open-source communities and help bring new features to market while shaping the pre-silicon roadmap and exploring cost/performance optimizations for diverse model families like Llama, Stable