Neuron Runtime Software Development Engineer , Neuron Runtime (AWS)

Amazon; Seattle (WA); On-site; USD 143,700 - 194,400; Full time

Benefits offered by this job

Health insurance

Dental

Vision

RSUs

401(k) matching

Paid time off

Parental leave

Job summary

Amazon is seeking a Software Development Engineer for the AWS Neuron Runtime Team to build and maintain high‑performance runtime libraries and drivers for AI accelerators such as Inferentia and Trainium. You will design, develop, and deploy Neuron Runtime and other Neuron components, and contribute to profiling to optimize AI workloads across devices.

You will work with cross‑functional teams to enable performance insights, own end‑to‑end services, and participate in post‑incident reviews while

Qualifications

• 3+ years of professional software development experience.
• 2+ years of design or architecture experience focusing on reliability and scaling.
• Experience programming in at least one software programming language.

Responsibilities

• Design, develop, and deploy high‑performance runtime libraries and drivers for AI accelerators.
• Develop and maintain the Neuron Runtime, ensuring scalability, reliability, and usability across services.
• Collaborate with cross‑functional teams to generate key information in a C++ compiler that enables customers to understand and optimize performance.
• Drive innovation to support multiple machine‑learning frameworks (PyTorch, JAX, XLA) in the profiler.
• Own services end‑to‑end, including deployment, monitoring, alarming, on‑call responsibilities, and post‑incident reviews.
• Work with executive leadership and senior technical leaders to define product directions and deliver solutions at scale.

Skills

Software development

System design

Programming language

Education

Bachelor's degree in computer science or equivalent

Job description

Overview

AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud‑scale machine learning accelerators and the servers that use them. As the Software Development Engineer for the Neuron Runtime Team, you will work alongside engineers to develop and maintain high‑performance runtime libraries and drivers for machine learning applications and AI accelerators. You will design, develop and deploy Neuron Runtime and other Neuron components. The profiler plays a crucial role in helping internal and external customers optimize AI workloads across hardware platforms such as Trainium and Inferentia devices by providing deep insights into performance bottlenecks and system behavior.

Responsibilities

• Design, develop, and deploy high‑performance runtime libraries and drivers for AI accelerators.
• Develop and maintain the Neuron Runtime, ensuring scalability, reliability, and usability across services.
• Collaborate with cross‑functional teams to generate key information in a C++ compiler that enables customers to understand and optimize performance.
• Drive innovation to support multiple machine‑learning frameworks (PyTorch, JAX, XLA) in the profiler.
• Own services end‑to‑end, including deployment, monitoring, alarming, on‑call responsibilities, and post‑incident reviews.
• Work with executive leadership and senior technical leaders to define product directions and deliver solutions at scale.

Basic Qualifications

• 3+ years of professional software development experience (non‑internship).
• 2+ years of design or architecture experience for new and existing systems, focusing on reliability and scaling.
• Experience programming in at least one software programming language.

Preferred Qualifications

• 3+ years of experience in the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Bachelor's degree in computer science or an equivalent field.
• Hands‑on experience with AWS services such as EC2, ECS, CloudWatch, S3, and Lambda in production environments.

Compensation and Benefits

USA, WA, Seattle – $143,700.00 to $194,400.00 USD annually. The base salary range for this position is listed below. Your package will include sign‑on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance, dental, vision, prescription, basic life & AD&D insurance, supplemental life plans, EAP, mental health support, medical advice line, flexible spending accounts, adoption and surrogacy reimbursement coverage, 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

Equal Opportunity Employment

Amazon is an equal‑opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information.