Software Development Engineer III, Machine Learning Annapurna - System Integration

Amazon Inc.

Seattle (WA)

On-site

USD 168,000 - 227,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Amazon's Annapurna Labs in Seattle seeks a Software Development Engineer III to lead the design and delivery of AI-powered tooling for Trainium hardware, combining AI with deep hardware knowledge to achieve operational stability.

You will own system design decisions, mentor engineers, and collaborate across silicon and operations teams to implement scalable, reliable solutions with responsible AI practices.

Qualifications

  • 5+ years of non-internship professional software development experience.
  • 5+ years of programming with at least one software programming language experience.
  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
  • Experience as a mentor, tech lead or leading an engineering team.
  • Bachelor's degree in computer science or equivalent.

Responsibilities

  • Design and deliver generative AI-based tools that identify complex hardware failures, dynamically create repair instructions from hardware system designs, and automate the qualification framework for post-new-product-introduction hardware changes on Trainium systems.
  • Own system design decisions across the tooling software stack, evaluating tradeoffs in scalability, maintainability, and performance while partnering with silicon design and operations teams on cross-functional technical discussions.
  • Collaborate with hardware design and sustaining teams to align tooling updates with upcoming silicon changes, creating the right integration checkpoints to ensure successful delivery.
  • Drive adoption of engineering best practices across the team through code reviews, design reviews, and mentorship — raising the quality bar and helping fellow engineers grow.
  • Evaluate and refine generative AI model outputs used in the tooling platform, applying responsible AI practices to ensure accuracy and reliability at production scale.

Skills

Software development
System design
Mentorship / tech lead
Programming languages

Education

Bachelor's degree in CS

Job description

Description

Do you want to build AI-powered tooling that keeps custom silicon running reliably at scale? In Annapurna Labs at Amazon Web Services (AWS), we sit at the intersection of software and hardware, designing the systems that detect failures, generate repair instructions, and automate qualification for Trainium products. As a Software Development Engineer III, you will lead the technical design and delivery of this tooling platform — combining generative AI techniques with deep hardware knowledge to solve problems that few teams in the industry encounter. With hardware complexity and scope expanding rapidly, this is a rare opportunity to shape how we bring the next generation of custom chips to operational stability.

Key job responsibilities

  • Design and deliver generative AI-based tools that identify complex hardware failures, dynamically create repair instructions from hardware system designs, and automate the qualification framework for post-new-product-introduction hardware changes on Trainium systems.

  • Own system design decisions across the tooling software stack, evaluating tradeoffs in scalability, maintainability, and performance while partnering with silicon design and operations teams on cross-functional technical discussions.

  • Collaborate with hardware design and sustaining teams to align tooling updates with upcoming silicon changes, creating the right integration checkpoints to ensure successful delivery.

  • Drive adoption of engineering best practices across the team through code reviews, design reviews, and mentorship — raising the quality bar and helping fellow engineers grow.

  • Evaluate and refine generative AI model outputs used in the tooling platform, applying responsible AI practices to ensure accuracy and reliability at production scale.

A day in the life

You start your morning reviewing system health metrics for the tooling platform, then join a design review where a teammate walks through a new generative AI model for automated failure diagnosis on Trainium hardware. You ask probing questions that sharpen the approach. After lunch, you pair with an engineer to work through a tricky data-modeling problem, then shift to a cross-team sync with hardware design engineers to align on upcoming silicon changes that will require updates to your qualification automation. Later, you write a technical document outlining how the tooling will scale to support the next generation of Trainium products.

About the team

Our team within Annapurna Labs builds the AI-powered software tooling that ensures Trainium systems meet operational stability targets before handoff to sustaining teams. We work at the intersection of software and silicon alongside systems development engineers, software development engineers, and hardware engineers — a cross-functional mix that is rare even within AWS. As Annapurna Labs continues to expand its custom chip portfolio, we are investing in new generative AI capabilities and scaling our platform to keep pace. If you are excited about solving problems where software meets hardware at industry-leading scale, we would love to hear from you.

Basic Qualifications

  • 5+ years of non-internship professional software development experience

  • 5+ years of programming with at least one software programming language experience

  • 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience

  • Experience as a mentor, tech lead or leading an engineering team

Preferred Qualifications

  • 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience

  • Bachelor's degree in computer science or equivalent

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits .

USA, CA, Cupertino - 193,300.00 - 261,500.00 USD annually

USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr. Software Development Engineer, Trainium Systems
Sr. Software Development Engineer, Trainium Systems

Annapurna Labs • Cupertino (CA)

On-site
USD 193,000 - 262,000
Health insurance
RSUs (Restricted Stock Units)
401(k) matching
Software Development Engineer, Trainium Systems
Software Development Engineer, Trainium Systems

Amazon.com Inc. • Seattle (WA)

On-site
USD 165,000 - 224,000
Software Development Engineer III, Annapurna Labs
Software Development Engineer III, Annapurna Labs

Annapurna Labs • New York (NY)

On-site
USD 185,000 - 250,000
Health insurance
401(k)
Paid time off
+1
Software Development Engineer, Neuron Collectives, Annapurna Labs
Software Development Engineer, Neuron Collectives, Annapurna Labs

Amazon Web Services • Cupertino (CA)

On-site
USD 165,000 - 224,000
Health insurance
401(k) matching
Paid time off
+1
Software Development Engineer, Generative AI, Annapurna Labs - Neuroboros Team
Software Development Engineer, Generative AI, Annapurna Labs - Neuroboros Team

Amazon Inc. • New York (NY)

On-site
USD 158,000 - 214,000
Sign-on payments
Restricted stock units (RSUs)
Health insurance
+3
Sr. Systems Development Engineer (AWS Generative AI & ML Servers), AWS HW Engineering
Sr. Systems Development Engineer (AWS Generative AI & ML Servers), AWS HW Engineering

Amazon Web Services (AWS) • Seattle (WA)

On-site
USD 151,000 - 205,000
Health insurance
RSUs
Career growth opportunities
Systems Development Engineer (AWS Generative AI & ML Servers), AWS HW Engineering
Systems Development Engineer (AWS Generative AI & ML Servers), AWS HW Engineering

Amazon Web Services (AWS) • Cupertino (CA)

On-site
USD 149,000 - 201,000
Software Development Engineer, Trainium Systems
Software Development Engineer, Trainium Systems

Annapurna Labs • Seattle (WA)

On-site
USD 144,000 - 194,000
Systems Development Engineer (AWS Generative AI & ML Servers), AWS HW Engineering
Systems Development Engineer (AWS Generative AI & ML Servers), AWS HW Engineering

Amazon Web Services (AWS) • Austin (TX)

On-site
USD 129,000 - 175,000
Software Development Engineer, Neuron Collectives, Annapurna Labs
Software Development Engineer, Neuron Collectives, Annapurna Labs

Annapurna Labs • Cupertino (CA)

On-site
USD 165,000 - 224,000
Sign-on payments / RSUs
Health insurance (medical, dental, etc
401(k) matching
+2