Neuron Runtime Software Development Engineer , Neuron Runtime

Amazon; Cupertino (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Health insurance (medical, dental, and

Vision and prescription coverage

Job summary

Amazon is seeking a Software Development Engineer for the Neuron Runtime Team to develop and maintain high-performance runtime libraries and drivers for ML applications and AI accelerators. You will design, deploy Neuron Runtime components and advance profiling to optimize workloads on Trainium and Inferentia devices.

You will also work on improving ML kernel and framework performance, manage the runtime life cycle, and collaborate with teams to expose key performance data through the C++

Qualifications

• 3+ years of non-internship software development experience.
• 2+ years of design or architecture experience (design patterns, reliability, scaling) of new and existing systems.
• Experience programming in at least one software programming language.

Responsibilities

• Develop and maintain high-performance runtime libraries and drivers for machine learning applications and AI accelerators.
• Design, develop, and deploy Neuron Runtime and other Neuron components.
• Enhance profiling capabilities to help internal and external customers optimize AI workloads across Trainium and Inferentia devices.
• Improve performance of ML kernels and ML frameworks.
• Manage the full development life cycle of the Neuron Runtime, ensuring scalability, reliability, and usability.
• Collaborate with cross-functional teams to ensure the C++ compiler exposes key performance information for customers to understand and optimize performance.
• Drive innovations to support multiple frameworks (e.g., PyTorch, JAX, XLA).

Skills

Software development experience

Design/architecture

Programming languages

Education

Bachelor’s degree in computer science

Job description

Overview

AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the servers that use them. As the Software Development Engineer for the Neuron Runtime Team, you will develop and maintain high-performance runtime libraries and drivers for machine learning applications and AI accelerators. You will work on design, development, and deployment of Neuron Runtime and other Neuron components. The profiler enables internal and external customers to optimize AI workloads across hardware platforms such as Trainium and Inferentia devices by providing deep insights into performance bottlenecks and system behavior. You will help improve performance of ML kernels and ML frameworks. You will manage the full development life cycle of the Neuron Runtime, ensuring scalability, reliability, and usability. You will collaborate with cross-functional teams to ensure that the C++ compiler exposes key information so customers can understand and optimize the performance of our custom hardware. Additionally, you will drive innovations that allow the profiler to support multiple frameworks, such as PyTorch, JAX, and XLA.

Responsibilities

• Develop and maintain high-performance runtime libraries and drivers for machine learning applications and AI accelerators.
• Design, develop, and deploy Neuron Runtime and other Neuron components.
• Enhance profiling capabilities to help internal and external customers optimize AI workloads across Trainium and Inferentia devices.
• Improve performance of ML kernels and ML frameworks.
• Manage the full development life cycle of the Neuron Runtime, ensuring scalability, reliability, and usability.
• Collaborate with cross-functional teams to ensure the C++ compiler exposes key performance information for customers to understand and optimize performance.
• Drive innovations to support multiple frameworks (e.g., PyTorch, JAX, XLA).

Basic Qualifications

• 3+ years of non-internship software development experience.
• 2+ years of design or architecture experience (design patterns, reliability, scaling) of new and existing systems.
• Experience programming in at least one software programming language.

Preferred Qualifications

• 3+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations.
• Bachelor’s degree in computer science or equivalent.

Compensation and Benefits

The base salary range is listed below; compensation includes sign-on payments and restricted stock units (RSUs). Benefits include health insurance (medical, dental, vision, prescription), life insurance, EAP, mental health support, Flexible Spending Accounts, adoption and surrogacy reimbursement, 401(k) matching, paid time off, and parental leave. Learn more about benefits at the Amazon benefits page.

Equal Opportunity

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.