Neuron Runtime Engineer - ML Accelerators & Profiling

Amazon; Seattle (WA); On-site; USD 144,000 - 194,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon's AWS Neuron team is seeking a Software Development Engineer to build and maintain high-performance runtime libraries and drivers for ML accelerators like Inferentia and Trainium. You will own Neuron Runtime's development lifecycle, focusing on scalability, reliability, and usability while coordinating with cross-functional teams to optimize performance insights.

You will contribute to compiler information generation enabling customers to understand and optimize workloads, and drive

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture experience (design patterns, reliability and scaling).
• Experience programming with at least one software programming language.

Responsibilities

• Develop and maintain high-performance runtime libraries and drivers for ML accelerators.
• Lead design, development, and deployment of Neuron Runtime and related components.
• Collaborate across teams to ensure the compiler generates key information for performance optimization across frameworks.

Skills

Software development

System design

Programming languages

Education

Bachelor's degree

Job description

Amazon's AWS Neuron team is seeking a Software Development Engineer to build and maintain high-performance runtime libraries and drivers for ML accelerators like Inferentia and Trainium. You will own Neuron Runtime's development lifecycle, focusing on scalability, reliability, and usability while coordinating with cross-functional teams to optimize performance insights.

You will contribute to compiler information generation enabling customers to understand and optimize workloads, and drive