Neuron Runtime Engineer: ML Inference & Profiling

Amazon; Cupertino (CA); On-site; USD 165,000 - 224,000; Full time

Job summary

Amazon's AWS Neuron team is seeking a Software Development Engineer to build and maintain high-performance runtime libraries and drivers for ML accelerators. You will work on Neuron Runtime components and ensure scalability and reliability across distributed systems.

Collaboration with cross-functional teams will drive optimizations for multiple frameworks, including PyTorch and XLA. The role emphasizes end-to-end ownership, deployment, monitoring, and on-call readiness within a fast-paced AWS

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• Experience programming with at least one software programming language.

Responsibilities

• Develop and maintain high-performance runtime libraries and drivers for ML applications and AI accelerators.
• Work on design, development, and deployment of Neuron Runtime and other Neuron components.
• Manage the full development life cycle of the Neuron Runtime, ensuring scalability, reliability, and usability.
• Collaborate with cross-functional teams to ensure the compiler generates key information for customers to optimize performance.

Skills

Software development

System design

Programming languages

Education

Bachelor's degree in Computer Science or equivalent

Job description

Amazon's AWS Neuron team is seeking a Software Development Engineer to build and maintain high-performance runtime libraries and drivers for ML accelerators. You will work on Neuron Runtime components and ensure scalability and reliability across distributed systems.

Collaboration with cross-functional teams will drive optimizations for multiple frameworks, including PyTorch and XLA. The role emphasizes end-to-end ownership, deployment, monitoring, and on-call readiness within a fast-paced AWS