Runtime/Driver Software Development Engineer, Neuron Runtime

Amazon Web Services (AWS); Austin (TX); On-site; USD 143,700 - 194,400; Full time

Job summary

Annapurna Labs (U.S.) Inc. is seeking a Software Engineer for the AWS Neuron SDK team in Austin, TX. You will build the runtime stack and device drivers to maximize performance on AWS Inferentia and Trainium accelerators.

The role emphasizes Linux driver development, low-level software, pre-silicon validation, and interfaces with hardware teams to push throughput, reliability, and cost efficiencies across inference and training workloads.

Qualifications

• 3+ years of professional software development experience.
• 2+ years of design or architecture experience for new or existing systems.
• Experience programming in at least one software language.

Responsibilities

• Define interfaces and develop runtime stack and driver for accelerators.
• Work in pre-silicon environments (emulation) to shift-left readiness and validation content.
• Collaborate with hardware and software teams to maximize throughput and cost efficiency.
• Deliver high-quality, scalable software in a fast-paced environment.

Skills

Software development

System design

Programming languages

Education

Bachelor's degree in Computer Science or equivalent

Tools

Low level drivers

Job description

Description

Neuron SDK is the complete software stack for the AWS Inferentia and Trainium machine learning accelerators designed by Annapurna Labs inside AWS. The Neuron SDK consists of a compiler, runtime, frameworks, and tooling customers need. It’s also preinstalled in Amazon Deep Learning AMIs and Deep Learning Containers for customers to quickly get started with running high performance and cost-effective inference and training.

Description

Neuron SDK is the complete software stack for the AWS Inferentia and Trainium machine learning accelerators designed by Annapurna Labs inside AWS. The Neuron SDK consists of a compiler, runtime, frameworks, and tooling customers need. It’s also preinstalled in Amazon Deep Learning AMIs and Deep Learning Containers for customers to quickly get started with running high performance and cost-effective inference and training.
This position is for a Software Engineer for the AWS Neuron SDK team with a deep background in Linux and device drivers. Deep knowledge and experience with hardware-based accelerator platforms and the necessary complexity for the software layers that interact and manage them. Experience implementing high performance software drivers, needed to ensure high throughput from software to hardware, is also a necessity. This engineer will work with the team to define the key interfaces and will develop the runtime stack and driver that manages the accelerator. This engineer will also work in pre-silicon environments (such as emulation) to shift-left Runtime Software Stack readiness and to develop validation content to checkout HW/Silicon features.
This is a fast-paced, intellectually challenging position, where you’ll work with thought-leaders in multiple technology areas. You’ll have high standards for yourself and everyone you work with, and you’ll be constantly looking for ways to improve our products' performance, quality and cost.
We’re changing an industry, and we want individuals who are ready for this challenge and want to reach beyond what is possible today.
Basic Qualifications

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience programming with at least one software programming language
  

Preferred Qualifications

• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent
• Experience in computer architecture
• Experience writing low level drivers
  

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, TX, Austin - 143,700.00 - 194,400.00 USD annually

Company - Annapurna Labs (U.S.) Inc.

Job ID: A10448305