Neuron Runtime Software Engineer - High-Performance ML SDKs

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 165,200 - 223,600; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Web Services (AWS) Cupertino is seeking a Software Development Engineer for the Neuron Runtime Team to build and maintain high-performance runtime libraries and drivers for ML accelerators.

You will own the full development lifecycle for Neuron Runtime, collaborating across teams to optimize performance and enable support for PyTorch, JAX, and XLA within a distributed cloud environment. Strong background in distributed systems and AWS services is valued.

Qualifications

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
• Experience programming with at least one software programming language.

Responsibilities

• Develop and maintain high-performance runtime libraries and drivers for ML applications and AI accelerators.
• Work on design, development, and deployment of Neuron Runtime and other Neuron components.
• Improve performance of ML kernels and frameworks across hardware like Trainium and Inferentia.

Skills

C/C++

Distributed systems

Software development

Education

Bachelor's degree in CS or equivalent

Job description

Amazon Web Services (AWS) Cupertino is seeking a Software Development Engineer for the Neuron Runtime Team to build and maintain high-performance runtime libraries and drivers for ML accelerators.

You will own the full development lifecycle for Neuron Runtime, collaborating across teams to optimize performance and enable support for PyTorch, JAX, and XLA within a distributed cloud environment. Strong background in distributed systems and AWS services is valued.