Senior AI/ML Software Engineer: Inference on Trainium

Amazon Web Services (AWS); Cupertino (CA); On-site; USD 193,000 - 262,000; Full time

Benefits offered by this job

RSUs

Health insurance

401(k) matching

Paid time off

Job summary

Amazon's Annapurna Labs (U.S.) Inc. is seeking a Sr. Software Development Engineer to onboard and optimize state-of-the-art LLMs for Trainium inference on Neuron accelerators.

You will drive model enablement speed, usability, and quality through features, tooling, and automation. You will contribute to architecture decisions across the Neuron serving stack, mentor engineers, and collaborate with customers and product teams to shape technical strategy and deliver high-performance inference

Qualifications

• 5+ years of programming in a modern language (Java, C++, or C#) with OO design experience.
• 5+ years of leading design or architecture of new and existing systems.
• 5+ years of full SDLC experience including coding standards, reviews, build, testing, and operations.
• 5+ years of non-internship professional software development experience.
• Experience as a mentor, tech lead, or leading an engineering team.

Responsibilities

• Deliver high-performance models using distributed inference libraries.
• Drive architectural decisions impacting the Neuron serving stack.
• Mentor team members and provide technical leadership across multiple work streams.
• Collaborate with customers, product owners, and engineering teams to define technical strategy.
• Author technical documentation, design proposals, and architectural guidelines.

Skills

Java

C++

C#

OO design

Tech lead

Education

Master's degree in Computer Science

Job description

Amazon's Annapurna Labs (U.S.) Inc. is seeking a Sr. Software Development Engineer to onboard and optimize state-of-the-art LLMs for Trainium inference on Neuron accelerators.

You will drive model enablement speed, usability, and quality through features, tooling, and automation. You will contribute to architecture decisions across the Neuron serving stack, mentor engineers, and collaborate with customers and product teams to shape technical strategy and deliver high-performance inference